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1. Introduction and discussion of the main results 

I. Introduction. Throughout the last two or three decades, the theory of 
rigidity, particularly in relation to semisimple groups and their discrete sub- 
groups, has become an extremely active mathematical field, where tools from 
diverse areas are simultaneously being employed. In retrospect, it seems that 
two major achievements in the early 70's have set up somewhat parallel direc- 
tions in which the theory emerged. These were Mostow's theorem, which, at 
least in its original form, was concerned with strong rigidity of lattices in rank 
one Lie groups, and Margulis' theorem, pertaining to the superrigidity of lat- 
tices in higher rank groups. Mostow's proof, and the theory which followed his 
result, are mainly geometric, making a strong use of the hyperbolicity phenom- 
enon in its various forms. The theory of quasi-isometries, negatively curved 
manifolds (and groups), and the abstract generalization to CAT(-l) spaces, 
which were deeply pursued by Gromov and his successors, may be viewed as 
far-reaching developments of Mostow's fundamental ideas. Margulis' theorem, 
on the other hand, initiated what is now called the (algebraic) ergodic theory of 
semisimple groups. Zimmer's cocycle superrigidity theorem with its numerous 
applications, and the work of many others, developed Margulis' ideas to create 
a striking theory for higher rank groups, and particularly a "nonlinear" finite 
dimensional rigidity theory. Although drawing on many geometric techniques, 
this theory relies primarily on measure and ergodic theoretic tools. 

A glance at the statement of Mostow-Margulis theorems may hint at the 
nature of the theories. While an assumption of faithfulness or discreteness on 
the homomorphism of the lattice is a typical feature of the rank one theory, 
and owes much to its geometric methods, in the higher rank case one usually 
aims to get sharp rigidity under extremely weak conditions. Of course, this 
is hardly a shortcoming of the methods, as it is well-known that the groups 
SO(n, 1) and SU(n, 1) fail to have many of the rigidity properties shared by 
the higher rank groups. It should be mentioned, however, that thanks to the 
well-known results of Corlette and Gromov-Schoen, the rank one Lie groups 
Sp(n, 1) and -F4(_2o) do exhibit remarkable rigidity phenomena (see also [Pa]), 
even if they do not enjoy many of the methods and results the higher rank 
theory can ofi"er. 

In this paper, we attempt to bring closer the rank one and the higher 
rank theories, in addressing some rigidity questions for the groups S0(7t,, 1), 
SU(n, 1), which are motivated by, and mostly answered in, the higher rank 
theory. Before elaborating on the precise details, let us describe briefly three 
examples, which together may help to put our results in a better perspective. 

Recall that every isometric action of a higher rank (irreducible) lattice 
on a tree, fixes a vertex (in most cases this follows from property (T)). For 
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lattices in SO(n, 1) this is well-known not be the case. However, we will show 
that the ambient group does impose a strong limitation on such actions, and 
even if these lattices need not admit a global fixed vertex, "large" subgroups 
of them always do. Next, the normal subgroup structure of higher rank lat- 
tices, being known to be "trivial" (due to Margulis), is completely analyzed. 
In particular, the issue of noninjective homomorphisms of them never arises. 
On the other hand, uniform lattices in rank one groups are word hyperbolic, 
hence by Gromov's theory, admit many normal subgroups. Actually, some of 
these lattices are known to surject onto a nonabelian free group, a fact which 
hardly encourages attempts to study general noninjective homomorphisms. We 
will nevertheless explore some nonfaithful (discrete) linear representations of 
these lattices, and show that the algebraic normal subgroup structure is indeed 
subject to some geometric constraints. Finally, Zimmer applied his cocycle su- 
perrigidiy theorem, making use of a deep theorem of Gromov, to show that a 
fundamental group of a compact manifold on which a higher rank group acts, 
preserving some geometric structure, must be, roughly speaking, at least as big 
as the group acting. We will show a similar phenomenon taking place when 
the group acting is SO(n, 1) or SU(n, 1), relying on a stronger consequence of 
Gromov's work. In light of the existence of free quotients of lattices, construc- 
tions of compact manifolds on which the ambient group acts are quite flexible 
(using suspension), making such results less expected in general. Our rigidity 
theorem (see 1.2, 1.3 below) serves here as a bridge, extending both Zimmer's 
work to the rank one setting, and a result on rank one lattices, due to Yue and 
Bourdon (see Theorem 1.1 below). While the method we suggest is new, the 
treatment, using cocycles and the framework of principal bundles, is directly 
influenced by Zimmer's approach. 

The proofs of our results are based heavily, in a new fashion, on unitary 
representations of semisimple groups, and their cohomology. Although the 
discussion so far highlights the rigidity aspects, in order to approach these, 
we prove some results in the representation theory of SO(n, 1) and SU(n, 1), 
which seem of independent interest. Somewhat surprisingly, it will become 
evident that the reason for the absence of many rigidity phenomena in these 
groups, particularly, their failure to have property (T) of Kazhdan, is our 
main source of strength, being intimately related to the methods we develop. 
In fact, as far as the subject of asyniptotics of matrix coefficients is concerned, 
we remain with a better understanding of the groups SO(n, 1) and SU(n, 1) 
than the higher rank groups, and here it is not clear to us whether this has 
to do only with our approach. (The other rank one simple Lie groups seem to 
fall, once again, in the middle.) We shall return to elaborate on this matter 
after describing more fully the main results. 
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II. Statement of the main results. Hereafter, unless specified otherwise, G 
denotes a simple Lie group with finite center, (locally) isomorphic to SO(n, 1) 
with n > 3, or SU(n, 1) with n > 2 (that is, SL2(M) is excluded through- 
out this section), and K < G denotes a maximal compact subgroup. Wc fix 
the G- invariant Riemannian metric d on G/K, normalized to have constant 
(maximal) —1 sectional curvature when G = SO(n, 1) (SU(n, 1), resp.). This 
makes the natural equivariant embeddings of the different symmetric spaces, 
one in the other, isometric. Fix also once and for all the i^-invariant point 
o = e G G/K as an "origin" for all the spaces (we may view them all em- 
bedded, say, in some SU(n, 1)/K for a large n). Recall the notion of critical 
exponent 5, of a discrete subgroup A < G, which will play a central role in the 
sequel, providing a natural geometric measurement of the size of a subgroup: 

1.0 Definition. 5{K) = inf{s | e-^'^(^°'°) < oo}. 

Note that 5{A) does not depend on the ambient group G, in the sense 
that if A < Gi < G2, where Gi < G2 is a natural inclusion, then its value is 
the same whether we regard A as a subgroup of Gi or G2. Some well-known 
properties of 5 to be used, are found in Lemma 2.7 below. Wc only recall here 
that if r is a lattice in G = SO(n, 1) {n > 3), then 6{T) = n — 1 (a value which 
we assign, for the time being by formal notation, also to 6{G)), while if F is a 
lattice in G = SU(n, 1) (n > 2), then S(T) = 2n (= S{G), as before). 

1.1 Theorem. Let T < G be a lattice, and (p :T ^ K he an isomorphism 
of F with a discrete subgroup A of some H = SO(m, 1) or SU(m, 1). Then 

m < d{A). 

Theorem 1 . 1 extends a result proved in [Yue] , where A is assumed geomet- 
rically finite. In [Yue] and [Boul] the case of equality is studied, which leads to 
a beautiful superrigidity theorem in this case. After this work was completed, 
G. Besson, G. Courtois and S. Gallot drew our attention to their recent paper, 
in which the result of Bourdon and Yue is strengthened, and the assumption 
on A removed as well (see [BCG, 1.15]). Yet, in all of the aforementioned pa- 
pers, the lattice F is assumed to be uniform, an assumption which is relaxed in 
Theorem 1.1. Two of our main results present generalizations of this theorem, 
each in a different direction. 

The first direction in which Theorem 1.1 can be extended, concerns uni- 
form lattices F, viewed as (essentially) the fundamental group of the compact 
G-space G/F. Let G be a connected Lie group, and suppose it acts contin- 
uously on a compact manifold M. Then standard covering space arguments 
show that the universal covering G of G acts naturally on the universal cover- 
ing M of M. Although we are interested in both families of groups SO(n, 1) 
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and SU(n, 1), the fact that the fundamental group of those in the second family 
is infinite, makes the formulation of our next result a little more technical for 
them. For simplicity, we discuss here only G = SO(n, 1) (n > 2). 

1.2 Theorem. With the above notation and assumptions on G and M, 

suppose that the G- action on M preserves a finite measure, and that the action 
of G on M is measurably proper with respect to the natural lift of the invariant 
measure. That is, for almost all x G M the stabilizer Gx is compact, and the 
orbital map g gx from G/G^ to M, is proper. If iti{M) is isomorphic to a 
discrete infinite subgroup A of H = SO(m, 1) or SU(m, 1) {for some m), then 
S{G) < (5(A). 

A simple example of a situation where the condition in Theorem 1.2 holds 

is when there is at least one element g (z G which acts properly discontinuously 
on M. (This is an easy consequence of the Cartan decomposition, and the rank 
one property.) Gromov's work on rigid transformation groups, [Gr2], [Zi2, 4.5], 
provides another general geometric situation in which this condition is satisfied: 

1.3 Corollary. Let G be locally isomorphic to SO(n, 1) for n > 3. 

(i) Suppose that the G- action on M is real analytic and preserves volume 
and a rigid (analytic) geometric structure in the sense of Gromov [Gr2] [this 
includes Cartan^ s classical notion of a structure of finite type, e.g., a pseudo- 
Riemannian metric or an affine connection). If -ki{M) is infinite, and embeds 
discretely in SO(m, 1) or SU(m, 1), then S{G) < 6{7ri{M)). 

(ii) In particular, in the situation of (i) above, if tti (M) is embedded as an 
infinite, geometrically finite subgroup, in the same Lie group G, then it must 
be a lattice there. 

Thus, SO(n, 1) cannot act real analytically on a compact manifold M, 
preserving volume and a connection, if 7ri(M) is infinite and embeds discretely 
in SO(n — 1, 1). This type of result holds also when G = SU(n, 1); however here 
one has to take into account the possible embedding of the (infinite) center of 
G in 7ri(M). We will take up this technicality in Section 7. II, where the proof 
is presented (see Theorem 7.1 and the preceding discussion). 

As mentioned earlier. Theorem 1.2 and Corollary 1.3 were motivated by 
results of Zimmer in the higher rank case, which, although similar in spirit, are 
much sharper (see e.g. the account in [Zi2] and the references therein). The 
superrigidity for cocycles, in conjunction with Ratner's theorem, yields striking 
consequences, which are simply not valid in our case. We remark that while 
in Zimmer's work, Gromov's theorem was applied to verify a mild "engaging" 
condition, we rely on its being stronger, to obtain the fastest possible decay 
of the matrix coefficients for the G-representation on L^(M). It may also be 
interesting to mention that part (ii) in Corollary 1.3 is now established for 
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all simple Lie groups excluding SL2(M). The higher rank C3<SG, clS mentioned, 
follows from Zimmer's work (see [Zi2, §5]); the case of Sp(n, 1) and F^_2o) 
from a weaker version of the cocycle superrigidity theorem, established by 
Zimmer and Corlcttc via harmonic maps technique [CZ, Theorem 4.2] (and by 
application of Ratner's theorem in an argument identical to that in [Zi2]). The 
remaining groups are taken care of above (they are the only ones for which an 
additional geometric assumption on the image is currently required). 

A different way in which Theorem 1.1 may be generalized is by considering 
also noninjective homomorphisms. There seem to be few known results in this 
situation. 

1.4 Theorem. With the assumptions and notation of Theorem 1.1, and 
with (f noninjective as well, the following inequality holds: 



For instance, if 6{(p{T)) < 2 (e.g., (p{T) is a free group), one necessarily 
has 5(Ker ip) > S{T) — 1 (actually, strict inequality must hold; see Theorem 5.6 
below). We do not know if inequality (1) is tight in a way more interesting 
than the fact that equality holds when cp extends to G. In fact, we believe that 
equality occurs exactly in that case (see §8.3 below for a further discussion). 
Indeed, a more symmetric expression on the right-hand side of (1) might be 
expected, one which resembles better the sum of S on the kernel and the image. 
The appearance of 2 in the denominator has its origins (in the proof), in the 
special role played by the regular {=L'^) representation. Nevertheless, one 
should keep in mind the following: 

Observation. For every n > 2 there exists a lattice F < SO(n, 1), and 
some a < S{T), such that the following holds: for every £ > one can find 
tp-.r^T with 5{Kevip) < a and 6{ip{T)) < s. 

This is explained after the proof of Theorem 1.4, in Section 7.1. We note 
that by a result in [B J] , the critical exponent may be replaced (here, as in all of 
our results) by the Hausdorff dimension of the radial limit set. Notice however, 
that measuring the full limit set is too crude for our purposes, as the latter is 
the whole boundary for any infinite normal subgroup of a lattice, whereas the 
critical exponent of such a subgroup strictly decreases if the quotient by the 
lattice is nonamenable (see the last paragraph of §7.1). 

A result in a more general geometric framework is the following: 

1.5 Theorem. Let A be a finitely generated nonamenable group, whose 

first i'^-Betti number vanishes. Then for any discrete faithful representation 
of A into SO(ri, 1) or SU(n, 1), the image has critical exponent at least 2. 



(1) 




5(^(F)) 
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Moreover, in case of equality, the image must be of divergent type {that is, the 
series in Definition 1.0 diverges at s = 2). 

Note that by Sullivan's work [Sul], the additional information in case of 
equality is of interest. The result itself is tight, as ean be seen by lattices in 
SL2(C). There are various families of groups to which Theorem 1.5 applies, 
such as fundamental groups of closed Kahler manifolds (which are not commen- 
surable to a surface group). See Section 4.III for more examples, applications 
and references. 

1.6 Theorem. Let T < G he as in Theorem 1.1, and suppose that T acts 
by isometrics on a (simplicial) tree T, without a fixed vertex. Then there exists 

an edge in T, whose stabilizer C <T satisfies S{C) > S(T) — 1. Furthermore, 
if G = SU(n, 1), or if the tree T is locally finite and G ^ S0(3, 1), then for 
some edge stabilizer C, strict inequality must hold. 

In particular, if F = A *c B is a free product of its subgroups A and B, 
over the amalgamated subgroup C, then 5{C) > S(T) — 1, and strict inequality 
holds ifG = SV{n, 1), or if G S0(3, 1) and \A:C\< oo, {B:G\< oo. 

Notice that we do not assume any kind of geometric condition on the 
action, or the stabilizers. The bound for SO(n, 1) is sharp, as is best seen in 
the constructions of nonarithmetic lattices by Gromov and Piatetski-Shapiro 
[GPS], which admit a splitting where the amalgamated subgroup C is a lattice 
in SO(n — 1,1). The strengthening to strict inequality relies, in the case of 
SU(n, 1), also on a result of Gromov and Schoen [GS] using harmonic maps. In 
both cases this sharpening depends on an additional detailed spectral analysis, 
providing support to our belief that equality d{C) = S{T) — 1 comes only from 
geometric constructions of splittings of T (see also §8.2 below). Notice also 
that some lattices in SO(n, 1) do admit actions on locally finite trees, e.g., 
those coming from a homomorphism onto a nonabelian free group. 

A different application of our methods concerns the well-known problem 
of existence of compact quotients for homogeneous spaces. This problem has 
been addressed using numerous techniques, each providing a solution to some 
families of groups. Amongst the contributions in the last decade, we men- 
tion those of Kobayashi, Labourie, Mozcs and Zimmer (see [La] for a survey), 
and more recently, those of Benoist [Be] and Margulis-Oh ([Marl], [Oh]). The 
analysis of Margulis and Oh also uses decay estimates on matrix coefficients, 
but in a way completely different from the one we suggest. Our approach illus- 
trates another example of a "rank one result", inspired by Zimmer's "higher 
rank treatment" of the question. Both the formulation and the proof of the 
theorem are more convenient in the framework of discrete subgroups. 
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1.7 Theorem. Let G be a simple Lie group with finite center, and A < G 
be a discrete infinite subgroup which admits a discrete embedding in SO(n, 1) or 
SU(n, 1) for some n. Assume that there exists a nonamenahle closed subgroup 
L < G, with noncompact center, which commAites with A. Then G/A admits 
no compact quotients; i.e., there is no discrete subgroup T < G which acts 
properly discontinuously on G/A, with a bounded fundamental domain. 

For example, a situation, where Theorem 1.7 apphes naturally, is the 
following (compare with Zimmer's questions in [Zi3], and with [LZ]): 

Corollary. If G = SL„(M), n > 4, and H = SL2(M) < G is embedded 
naturally in the upper left comer, then G/H admits no compact quotients. The 
same is true ifW is replaced by C 

Replacing SL2(M) by a discrete co-compact subgroup A, one indeed re- 
duces the corollary to Theorem 1.7 (observing that L = GL2(M) can be taken 
in Theorem 1.7). 

III. The approach. To describe our approach, we shall first need to discuss 
further results and notions. Recall that if G is a locally compact group, and 
TT is a continuous unitary G-representation on the Hilbert space H, then tt is 
called strongly L^, if for a dense subspace Ho C H, the matrix coefficients 
g — {Tr{g)u,v) belong to U''^^{G) for all e > 0, for all u,v e Ho (in most 
examples wc shall encounter, the matrix coefficients need not be in L^{G); see 
§2.11 for further discussion). We note that for notational convenience, we allow 
here any value < p < oo, although standard properties of L^-spaces will be 
used only for p > 1 (all unitary representations are strongly L°°). 

Independently, as with all G-modulcs, one has the usual notion of (con- 
tinuous) first cohomology for a unitary G-representation, denoted by (see 
Definition 3.1 below). Keeping this in mind, we introduce the following invari- 
ant, which plays a key role in the present paper: 

1.8 Definition. For a locally compact group G, let p = p{G) denote the 
value: 

p{G)= inf{0 < p < oo| there exists some continuous unitary G-representation 

TT which is strongly L^, and satisfies H^{G,7t) ^ 0}. 

If G has no representation vr with H^{G,tt) ^ (i.e., G is Kazhdan), 
set p(G) = oo (other groups may satisfy p{G) = oo as well). On the other 
extreme, we shall see that once p{G) < 2, then actually p{G) = 0, which 
is equivalent to having nonvanishing of the first cohomology with coefficients 
in the regular representation. In the class of finitely generated groups, the 
latter occurs precisely for groups which are either amenable, or have nonzero 
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first ^^-Betti number, such as free groups (see Theorem 4.3). For the groups 
G = SO(n, 1), SU(n, 1) and their lattices, we shall establish the following result: 

1.9 Theorem. If T < G is a lattice, then p{G) = p{T) = 6{T){= 5{G)), 
as long as G is not locally isomorphic to SL2(M). In the latter case, p{G) = 
p{V) = 0. 

See Definition 1.0 for the notation and the numerical values of S. Notice 
that this invariant shows, in particular, that lattices in different SO(n, l)'s, 
say, can be distinguished by their representation theory (one which is far from 
being understood in any reasonable sense). 

The computation of ^i(r) when T is uniform is an easy consequence of the 
computation of p{G) (to which we shall shortly return), using a restriction- 
induction argument. The situation is different when T is nonuniform, as 
here one does not have in general an isomorphism between H*{T,tt) and 
H*{G, Ind^Tr). Similar subtle issues, concerning cohomology of nonuniform 
lattices, were studied mainly by Borel (see [Bor] and the references therein). 
Here we confine to the first cohomology, but need all unitary (possibly infinite 
dimensional) F-representations. This question and our approach to it are dif- 
ferent, and fortunately we are able to establish the following result, which is 
essential for the whole treatment of nonuniform lattices in this paper: 

1.10 Theorem. Assume G ^ SO(n,l) with n > 4, or G ^ SU(n, 1) 
with n > 2. Let T < G be a {nonuniform) lattice, and let tt be some unitary 
T-representation. Then: 

(2) H\r,7r) ^ i7^(G,Ind^7r). 

For the groups excluded in the theorem (which are locally isomorphic to 
SL2(M) or SL2(C)), we were informed by John Millson that (2) can indeed 
fail, when tt is the trivial representation. Our proof of Theorem 1.10 reduces 
to a question which is independent of tt, concerning the convergence of some 
integral over G/T. The question is essentially a geometric one, and relies on 
the structure and precise behavior of the cusps of G/T. The convergence of the 
integral is crucial in order for a map from the left- to the right-hand side in (2) 
to be well-defined. We remark that a similar divergence problem invalidates 
the proof of Raghunathan's local rigidity theorem [Ra] for the nonuniform 
lattices in SL2(C), a result which is indeed false in general. As in [GR, §8], 
where a substitute for local rigidity was found in this special case, an ad hoc 
argument is available here, using first £^-Betti numbers, to show that p{T) = 2 
when r < SL2(C). We also note that in [Sh2], Theorem 1.10 is proved also 
for irreducible higher rank lattices, using the deep result of [LMR], on the 
comparison between the word and Riemannian metrics on these groups. 
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Fix now G = SO(n, 1) or SU(n, 1). The computation of p{G), in Sec- 
tion 4, is carried out in several stages, starting by analysis of the case where tt 
is irreducible, and reliance on the classification of those representations with 
nontrivial coliomology, via Lie algebra cohomology. This proof docs not shed 
light on what seems to be a rather surprising coincidence: the equality in Theo- 
rem 1.9. For the groups SO(n, 1) we do indicate a different approach, involving 
more geometric arguments, proving the result without any classification, and 
explaining better (though not completely) this phenomenon. At any rate, the 
above classification yields information only on irreducible representations, and 
for these, only on the integrability of their K-Hnite matrix coefficients. To 
implement this classification, we prove the following result, which seems of 
independent interest: 

Theorem 1.11. Let K < G be a maximal compact subgroup, and tt be any 
unitary G-representation. //tt is strongly LP for some 2 < p < oo, then matrix 
coefficients of all K- finite vectors are in L^"'"^(G) for all e > {and satisfy 

an explicit decay estimate, depending on p and not on tt). Furthermore, every 
irreducible representation in the decomposition ofn into irreducibles is strongly 
LP as well. 

See Theorem 2.1 below for the explicit bound on the i^'- finite matrix 
coefficients, and for the complete result. Our proof makes essential use of 
the whole continuous strip of complementary series representations, and tight 
estimates of the corresponding spherical functions. See also Section 8.4 below 
for further discussion and several natural questions in this direction which 
remain unanswered. 

We shall see that Theorem 1.11 makes the abstract notion of strongly 
LP representations explicit and very amenable to work with. Still, one needs 
further information to deal with the second ingredient of Definition 1.8. This 
is provided by the following: 

Theorem 1.12. Let G be as above, and tt be any unitary G-representation. 
Let A < G be any noncompact subgroup. Then the natural restriction map 
H^{G,tt) i?^(A, ttIa) is infective. 

Theorems 1.9-1.12 will be repeatedly used throughout the proofs of the 
aforementioned rigidity results. Our strategy, roughly, is to show how the 
situation the group encounters, gives rise to a unitary representation with 
nonvanishing cohomology (e.g., by use of Theorem 1.12). After analyzing the 
decay of an appropriately chosen dense subspace of matrix coefficients (not 
necessarily i^-finite), we convert the information gained by Theorem 1.9 to 
the required geometric conclusion. 
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2. Unitary representations of SO(ri, 1) and SU(n, 1) 

I. General preliminaries and notation. We begin by recalling some of the 
structure and basic properties of the groups G = SO(ra, 1), SU(n, 1), while 
introducing some notation. 

Let F be the field M of real numbers, or the field C of complex numbers. 
Fix some n > 2 and let xixi + • • • + — Xn+ix^+i be a quadratic form 
of signature (n, 1) over F, where x — > x is the identity in the case F = M, 
and complex conjugation when F = C The groups SO(n, 1) and SU(n, 1) are 
defined as the subgroups of SL„+i(F) (F = M, C resp.) preserving this form. 
For F = C this group is connected, but when F = M the connected component 
has index 2, and for brevity we keep hereafter the notation SO(n, 1) for the 
connected component. 

Fixing the first m — n variables yields a natural embedding of SO(n, 1) 
(resp. SU(n, 1)) in SO(m, 1) (resp. SU(m, 1)), for m > n. In addition, SO(n, 1) 
embeds naturally in SU(n, 1). These groups are simple Lie groups of real rank 
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one. We fix the embedding of 

(1) ^^S0(1,1) = 



cosh t sinh t 
sinh t cosh t 



) 



= at 



in the lower right block, as a Cartan subgroup for all of them. In the case 
F = M., K = SO(n) embedded naturally in the upper n x n submatrix is a 
maximal compact subgroup. When F = C, K = S{U{n) x U{1)), where U{n) 
and U{1) (= {A G C| |A| = 1}) act only on the first n variables/last variable, 
resp., is a maximal compact subgroup. Let M be the ccntralizer of A in K. 
When F = M we have Af = SO(n — 1) (in the upper left (n — 1) x (n — 1) 
submatrix), and when F = C, M = S{U{n — 1) x AJ2) where A/2 denotes the 
scalar 2x2 matrices with |A| = 1, embedded in the lower right 2x2 block of 
U{n, 1). Denote by M the normalizer of A in K. Then M<iM has index 2, and 
a nontrivial element in the Weyl group W = M /M may be represented by the 
diagonal matrix w whose diagonal has —1 in the two entries n — 2, n — 1, and 
I's elsewhere. We have watw~^ = (i{-t)^ a-nd the action of 14^ on ^ gives rise to 
two (closures of) Weyl chambers, denoted A'^ = {at\t > 0}, A~ = {at\t < 0} 
(see (1)). The polar (or Cartan) decomposition G = KA^K holds, where for 
every g E G there is a unique element a G A'^ with g = kiak2- We may thus 
define the "Cartan projection" a : G ^ by the equality: 



Let a = Lie A, and let exp : — > A be the exponential map, with its 
inverse log : ^4 — >^ a its inverse. Then dimo = 1, and corresponding to our 
choice of positive Weyl chamber we fix a positive simple root (5. All the positive 
roots of a are either (3 or 2(5. For SO(n, 1) the roots arc all equal to /?, which has 
multiplicity n — 1. Notice that because we identify A as the Cartan subgroup 
of all the SO(n, l)'s, /3, as functional on a, does not depend on n, and it is 
the same unique positive simple root for all these groups. The same remark 
applies to SU(n, 1). Here the root /? has multiplicity 2n — 2, and 2/3 is also a 
root, with multiplicity 1. 

Let p = p{G) denote half sum of the positive roots of G. We define 5{G) 
as the (integral) value for which 2p = 6{G)(3. That is. 



Since for SO(n, 1), 2/3 is not a root, the sum of all the root spaces cor- 
responding to j3 is an abelian subalgebra, which corresponds to an abelian 
subgroup N = W^"^. In the case of SU(n, 1), the appearance of a (one dimen- 
sional) root space for 2/3, makes N a two-step nilpotent group, the so-called 
Heisenberg group, of dimension 2n — 1. The following Iwasawa decomposition 



(2) 



g = kia{g)k2 



ki € K, a{g) G 5 G G. 
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holds: 



(4) 



G = KAN. 



The Haar measure of G, denoted hereafter simply by dg, may be expressed 
in both polar and in Iwasawa coordinates (2), (4). We shall need both of them 
in the sequel, but recall now only that of the first one. If da, dk denote the 
Haar measures of A, K respectively, then the Haar measure of G in terms of 
the polar decomposition (2) is given by dg = J{a)dkdadk, where: 



n. Strongly representations: The complete formulation of Theorem 
1.11. Before we state the main result of Section 2, Theorem 2.1 below, some 
remarks on the notion of strongly LP representation (defined at the beginning 
of §1.111) are in order. The condition of LP~^^ integrability, rather than simply 
L^-integrability, may seem peculiar to the reader who comes across this notion 
for the first time. In fact, in the literature it is the latter condition for strongly 
LP representations which is sometimes used. However, it is well-known (see also 
Theorem 2.1 below), that matrix coefficients for "nice" vectors in irreducible 
representations of simple Lie groups are, for some p < cxo, in LP~^^ for all e > 0, 
but not in L^. Consequently, it will turn out to be convenient for us to use 
this definition. The "nice" vectors alluded to, are those which are X-finite. 
Recall that given a fixed maximal compact subgroup if in a semisimplc Lie 
group G, a vector v G TC is called K- finite if the dimension of Span{7r(if)t;}, 
denoted henceforth by dim;^ v, is finite. Often, the definition of strongly 
representations for simple Lie groups requires the subspace Hq to be that of 
if-finite vectors (always dense by the Peter-Weyl theorem), and sometimes 
this assumption is made implicitly. For our discussion, the distinction between 
assuming L^-integrability of matrix coefficients for the K-^vAte vectors, and 
this condition for some dense subspace, is crucial. Our next theorem, the main 
result of this section, shows in particular that for SO(n, 1), SU(n, 1), these two 
notions indeed coincide. See Section 8.4 below for more on this issue. 

2.1 Theorem. Keep the above notation and let G he a simple Lie group 
with finite center, locally isomorphic to either SO(n, 1) or SU(n, 1) (n > 2). 
There exists a constant C = C{G), such that for eyeiy unitary G-representation 
{tt,TC), and 2 < p < oo, the following conditions are equivalent: 




G = SO(n,l), 
G = SU(n,l), 
G = SO(n,l),SU(n,l). 



J(a)~e'5(G)^(i°s«), 



1. TT is strongly U". 
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{Recall that (5 is the simple positive root; a{g) and 6{G) are as in (2) and 



ily irreducible), the representation tTx is strongly for almost every x. 

4. If a is any unitary representation weakly contained in tt, then a is strongly 
U' as well. 

If in addition, tt is irreducible, then 1-4 are also equivalent to: 

5. There exists one nonzero diagonal matrix coefficient of n which is in 



Much of the rest of Section 2 will be devoted to proving Theorem 2.1. 
We remark here that a similar proof works for every rank one simple algebraic 
group over a non-Archimedean local field, and in fact for "large" subgroups 
of the automorphism group of a regular tree (e.g., unimodular noncompact 
subgroups acting transitively on its boundary). 

III. Preliminaries toward the proof of Theorem 2.1. Wc begin with a dis- 
cussion which essentially amounts to showing that (1) implies (2) in Theorem 
2.1 for p = 2, a result which follows also from [CHH]. However, we present an 
alternative, simple approach, and establish along the way other results which 
will be needed in the sequel. The reader interested in a short path to the basics 
of the pointwisc decay estimates (which arc fundamental in what follows), may 
find our treatment helpful (although Theorem 2.2 seems new, and may be of 
interest also to specialists). 

2.2 Theorem. Let G a unimodular, second countable, locally compact 
group, and K < G a compact subgroup. Denote by X = L'^{G) the regular 
G- representation, and let (7r,H) be some unitary G-representation satisfying 
the following two properties: 

(i) There exists a nonzero vector v eH such that {Tr{g)v, v) >0 for all g E G 

{we call such v a G-positive vector). 

(ii) TT^, the subspace of K -invariant vectors, has dimension 1. 

Let vk ^'H be the unique {up to scalar) nonzero K-invariant unit vector 
inH. Then for every K-invariant functions ip,'tp G L'^{G) with \\ip\\ = Wi/jW = 1, 
and for every g € G: 




not necessar- 



LP+%G) for all e > 0. 



(7) 



\{X{g)ip,il;)\ < {iT{g)vK,VK)- 
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Remark. If assumption (ii) is removed, we still have an inequality similar 
to (7), except that on the right-hand side a supremum over the X-invariant 
vectors has to be taken. If (ii) is replaced by the more flexible assumption, 

dimvr^ < oo, this supremum becomes again a maximum (this more general 
version may be useful in various examples of totally disconnected groups) . 

Proof. For a finite positive measure u on G, and a unitary G-represen- 
tation a, denote by o'{u) the corresponding convolution operator, defined by 
{a{v)u,v) = J{a{g)u,v) dv{g). Let m be the normalized Haar measure of 
K. If u is a positive G-vector, then Tr{m)v is clearly nonzero, G-positive, and 
if-invariant; hence by (ii) we deduce that vk is G-positivc. Therefore the 
right-hand side in (7) is nonnegative. By replacing the functions with their 
absolute values, we may assume that ip and i/j are nonnegative, discarding the 
absolute value on the left-hand side of (7). Suppose now that (7) fails for 
some go G G. Notice that by /"^-invariance, the set of g^s for which it fails 
is nonempty, open, and bi-X-invariant. Wc may therefore find a probability 
measure /x on G (continuous with respect to the Haar measure), which is bi- 
-invariant, and such that (7) fails in its support. This implies that ||A(/x)|| > 
{\{lj.)ip,ijj) > {Tr{fi)vK,VK)- We now observe that {tt{ij)vk-iVk) = ||7I"(m)I|) 
which together with the previous inequality yields ||A(/i)|| > ||7r(;u)||. To prove 
this observation notice that by left ii'-invariance of fi, for every u the vector 
7r(iJ,)u is i^-invariant; hence n{iJ,)u = t{u)vK, for some t(u) G C. Since -K{m)u 
is K-invariant, we have 7r(m)u = s{u)vk where \s{u)\ < \\u\\. Using the right 
if-invariance of fj, we get for every unit vectors u,w GTi.: 

\{Tr{fi)u,w)\ = \ {TT{n)Tr{m)u,w) \ = \{7r {h)s{u)vk,w)\ 

< \{Tr{fJ,)vK,'w)\ = \t{vK){vK,w)\ 

< \tivK){vK,VK)\ = {'^{IJ)vk,Vk)- 

Hence ||vr(/i)|| < {tt{ij.)vk,vk) < IK(/^)I|) a-nd equality must hold, as claimed. 
Now, the inequality ||A(/Lt)|| > ||7r(/i)|| we have established, contradicts the 
following result, whose proof therefore completes the proof of Theorem 2.2. 

2.3 Lemma. Let A = L'^{G) he the regular G-representation, and tt be 
a unitary G-representation with a positive G-vector. Then for every posi- 
tive, continuous, compactly supported, probability measure fx on G, one has: 
> l|A(/i)||. 

Proof. We first reduce the lemma to the case where /j, is symmetric. In- 
deed, denoting /i(-B) = ii{B~^), we see that the convolution v = fi * ji is 
symmetric, and for every unitary G-representation cr, one has: 

H^.)!! = ||a(A)a(/x)|| = ||a(/.)M/^)ll = IK)")!!' • 
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Hence, taking a = tt, A shows that proving the lemma for the symmetric 
measure v suffices. Now, denoting by the m-th convolution, we have 
7r(^"^) = 7r(^)™. Taking a bounded neighborhood U of the identity such that 
{Tr{g)v,v) > 1/2 for all g eU,we get for the G-positive vector v: 



(for the last inequality, the positivity of v was used). However, it is well- 
known and easily verified that for every locally compact group G, a symmetric 
continuous (compactly supported) probability measure /x, and a bounded open 
set U <^ G, one has /x2"(C/)V2n ^ ||A(^)|| (for discrete groups this result 
is due to Kesten [Kc] and similar arguments apply in general). It follows 
that ||vr(/i)|| > liminf(7r(;u)^"'u, u) > ||A(/u)||, which completes the proofs of 
Lemma 2.3 and Theorem 2.2. □ 

Remark. Notice that Lemma 2.3 yields a lower bound in terms of the 
regular representation on all the norms of convolution operators for represen- 
tations with positive vectors. One family of such representations is that of 
the form tt = {X, m) , where (X, m) is a quasi-invariant cr-finite G-measure 
space. Another is the family of representations of the form vr = o" cj, where a 
is any unitary G-representation and a is its contragredient dual (indeed, any 
vector v®v\s then positive). Therefore, ||7r (g) 7f(/x)|| > ||A(/i)|| for any unitary 
G-representation tt, where A and ii are as in Lemma 2.3. This generalizes a 
result of Pisicr [Pis], and when G is amenable, shows that tt (8) vf always con- 
tains weakly the trivial representation (which is the main result of [Bekl]). 
After the completion of the paper, we learned from B. Bekka that this notion 
of "positive vectors" had been studied by R. Godement [Go], who asked, in 
modern terminology, whether any representation (of an amenable group) with 
a positive vector, contains weakly the trivial representation. An affirmative 
answer for some groups was obtained by Bekka in [Bek2]. Lemma 2.3 yields 
the result for all (amenable) groups. 

As we observe below, (7) can be applied to get a sharp decay estimate on 
iiT-finite matrix coefficients, once an appropriate representation tt is present. 
We will be interested, however, not only in decay estimates for the regular 
representation, but in a more general class. Indeed, it is clear from the proof 
of Theorem 2.2 that the same result holds if we replace A by any unitary repre- 
sentation a which is weakly contained (see 2.4 below) in A. To see that, observe 
that for any such representation we have ||cj(/i)|| < ||A(;u)|| for every (not neces- 
sarily positive) continuous measure /U. All that was proved in the second part 
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of the proof is the inequality ||A(/Li)|| < ||7r(//)||, which then continues to hold if 
A is replaced by cr. As was shown by Eymard [Ey], the condition on norms of 
convolution operators is in fact equivalent to the weak containment of a in A. 
A more commonly known definition is the following: 

2.4 Definition. The G-represcntation a is said to be weakly contained in A, 
denoted cr -< A, if every n x n submatrix of a can be approximated, uniformly 
on compact subsets in G, by n x n submatrices of some multiple (perhaps 
countable) direct sum of A. 

See [CHH], [Sh3] and the references therein, for more on this notion. 
We now wish to derive from (7) an estimate for the matrix coefficients of all 
i^-finite vectors, not only iiT-fixed ones. For later use, we give this argument 
in a general framework (compare with [CHH] and [Ho, §7]). 

2.5 Proposition. Keep the notation of Theorem 2.2, but denote now by 
A the G-representation on L?'{M), where M is some a- finite, Borel measure 
G-space, on which G acts measurably by measure- preserving transformations 
{e.g., M = G). Suppose that the function F : G — > M has the property that 
every K-invariant unit vectors (p, V' £ L'^{M) satisfy for allg e G the inequality 
\{X{g)ip,tp)\ < F{g). Let a be a G-representation with a ~< X, and let u,v be 
some K- finite vectors in TCa- Then for all g G G: 

(8) \{a{g)u,v)\ < F{g) ■ {dimK u)^/'^{dimK v)^^'^ ■ \\u\\ ■ \\v\\. 

Proof. We claim that it is enough to establish (8) when cr = A. Indeed, 
first notice that this implies (8) when cr = oo • A. Next, fix i^'- finite vec- 
tors u,v £ TYcr, and apply the fact that every n x n submatrix of a can be 
approximated uniformly on compact subsets by submatrices of oo • A to the 
submatrix associated with a finite set of vectors including basis elements for 
both Spaxi.{Kv} and Span{Ku}. Restricting our attention to the ii'-action, 
it follows by its compactness, that the i^-representations on Spanji^v} and 
SpanjKu} are (properly) contained in oo • A (restricted to K), and that more- 
over the "approximating" vectors in oo • A can be chosen to span isomorphic 
if -representations (this is a standard exercise related to the discreteness of the 
so-called Fell topology, on unitary duals of compact groups). In particular, 
the dimension of the if-spans are the same, and since we are assuming now 
that the pointwise estimate (8) holds for the pointwise approximating matrix 
coefficients, it must also be satisfied by {a{g)u,v). 

We are thus reduced to the case cr = A. To establish (8) in that case, 
we first fix a countable dense subgroup Kq < K (recall G is assumed second 
countable). Given any if-finite vectors u,v (z L?'{M), define the functions: 

y?(m) = sup{|u(/em)| | k € Kq}, tp{m) = sVi.'g{\v{km)\ \ k G Kq). 
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Observe that since Ko is countable, the functions (f and ip are weh-defined 
as measurable functions, in the sense that they do not depend on the choice 
of u and v in their class of almost everywhere equal functions. The values of 
f{m) or Tp{m) may be infinite, but we shall shortly see that 99 and tjj arc in 
L'^{M), and in particular this can happen only on a null set. Once the latter 
L^-estimate is established, we deduce from the fact that ip and ip are Kq- 
invariant, and the continuity of the K-action on L'^{M) ([Zil, Appendix B.3]), 
that they are actually invariant under any k ^ K (as measurable functions). 
Thus, as 99 and ij: are also positive, and their matrix coefficient dominates 
(the absolute value of) that of u and v resp., in order to deduce (8) it only 
remains now to show that their L^-norms satisfy ||(^|| < (dim/^-n)^/^ • ||n||, and 
IIV'II < (dim;^i;)V2 . ||^;||. 

Assume for simplicity \\u\\ = 1 and set n = dmiK u. Let ui, ... , ii„ be an 
orthonormal basis for Ku. Then, for every k ^ K there exist unique complex 
numbers ^i(A;),... ,9n{k), such that u{km) = ^ 6'j(A;)ni(m) for almost every 
m G M. In fact, by the countability of Kq, almost every m satisfies the latter 
equality simultaneously for all k € Kq. Obviously, X] = 1- Now, by 

the Cauchy-Schwartz inequality, almost every m & M satisfies for all k G Kq: 

n n n n 

\u{km)\^ = I J2 Oi{k)ui{m)\^ < ^ |0,(A;)p • ^ |n,(m)p = ^ |n,(m)p. 

1=1 i=l i=l 1=1 

Therefore y?^(m) < ^ \ui{m)\'^ almost everywhere, and 

||<^|| = I < (|X: \<rn)\^)"' = E / Vik^)?)"^ = n^'^ 

as required. A similar analysis applies to the function ip. □ 

Theorem 2.2 and Proposition 2.5 yield together a pointwise estimate for 
all iT-finite vectors, in all the representations which are weakly contained in 
the regular representation, in terms of a single matrix coefficient of a special 
representation. In general, there may be several (even irreducible) representa- 
tions satisfying the assumptions of Theorem 2.2. Notice that the best estimate 
will be achieved if a representation tt as in Theorem 2.2 exists, which is itself 
weakly contained in the regular representation, for then the pointwise bound 
that it puts is sharp, being attained by the very same distinguished matrix 
coefficient. It is perhaps surprising that for any connected topological group 
(with K a maximal compact subgroup), such a representation can indeed be 
found (see the discussion after the following result). Although we shall not 
need it in the sequel, for completeness let us observe its uniqueness. 

2.6 Proposition. Let G he a locally compact, second countable group, 
and K a compact subgroup. Suppose that there exists a unitary G-representa- 



RIGIDITY AND UNITARY REPRESENTATIONS 



131 



tion which satisfies assumptions (i) and (ii) of Theorem 2.2, and is also weakly 
contained in the regular representation. Then there exists such an irreducible 
representation, and it embeds in any other representation with these properties. 
In particular, there is at most one irreducible representation satisfying all three 
properties. 

Proof. Suppose that vr satisfies all the properties, and that tti is another 
such representation. Let v, vi be i^-invariant unit vectors in the representation 
space of TT and tti, respectively. Then by Theorem 2.2 and Proposition 2.5 
we have {Tr{g)v,v) < {'n'i{g)vi,vi) for all g E G, and similarly, the opposite 
inequality holds. Thus, we have equality, which implies that the closures of 
the G-span of v and vi are isomorphic. Denoting the G-representation on these 
isomorphic subrepresentations by a, we see that a satisfies all the properties, 
and our argument shows that it embeds in any other representation sharing 
them. Wc show a is irreducible. Let Ha be the representation space for a, 
and Vu be the unique (up to scalar) i^T-invariant vector. Suppose we have a 
G-invariant decomposition TCa = "Hi + Ti.2, and write correspondingly Va = 
vi + V2. As Gva spans Ha, if f j = then Hi = {i = 1,2). However, both 
vi,V2 are if-invariant, hence multiples of Va, and orthogonal to each other. 
This is impossible unless one of them is zero. □ 

Notice that if G is totally disconnected, then a compact open subgroup 
K < G always exists, and if P < G is any cocompact subgroup, then the 
G-representation on L?'{G/P) has a finite dimensional subspace of i^-invariant 
vectors. Thus, (the more general version of) Theorem 2.2 can be applied, and 
if such amenable P exists, the additional condition in 2.6 is satisfied as well. 
On the other extreme, this phenomenon occurs when G is connected, and a 
representation L?'{G/P) of the latter form, satisfying the three conditions in 
2.6, always exists (when K is maximal compact). The general case here is 
reduced by a standard argument to that of a semisimple group, and although 
the latter may be dealt with generally, we shall discuss henceforth only the 
simple Lie groups which are of interest to us. 

We retain the notations of subsection I. Let G = KAN be as in (4), and M 
be the centralizer of A in K. Then P = MAN is an amenable subgroup, being 
a compact extension of the solvable group AN. We have G = K P. The quasi- 
regular G-representation on Lp'{G/P) obviously satisfies the two conditions of 
Theorem 2.2 (as K is transitive on G/P). It is also weakly contained in L^{G), 
since P is amenable; thus all three conditions in 2.6 hold. When we choose 
a quasi- invariant measure on G/P which is invariant under K, the Harish- 
Chandra S-function is defined as the diagonal matrix coefficient corresponding 
to the constant unit function. By 2.2 and 2.5, taking F{g) = '^{g) in (8) yields 
a (tight) bound on matrix coefficients of all i^-finite vectors in representations 
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a -< L'^{G). The first estimates of the H-function are due to Harish-Chandra. 
Here we shall use the following (sharp) estimate for the rank one Lie groups 
(see [GV, 4.6.4]): 

(9) -{g) < C{l + p{\oga{g))) ■ e-5'5(G)/3(ioga(ff))_ 

Preparing still for the proof of Theorem 2.1, we recall now some basic 
properties of the class one (also called "spherical") representations of G = 
SO(n,l), SU(n,l). 

Recall that a class one (irreducible) G-representation, is one that contains 
a nonzero vector invariant under K. Such vector is unique up to scalar. A 
general method to construct such representations is as follows: Let ac be the 
complexification of a = Lie A, and A G a^. Then man e^*^^°^") defines a 
character on P = MAN, which is unitary if and only if A G ia* . Inducing (uni- 
tarily) this P-representation to G, yields a representation ttx which is obviously 
unitary if A G ia*. In that case is called a principal series {spherical) repre- 
sentation. Denote by a ii'-invariant unit vector, with ip\{g) = {TTx{g)v,v). 
Since inducing any unitary representation from an amenable subgroup yields 
a representation which is weakly contained in the regular representation, from 
Theorem 2.2 and Proposition 2.5 it follows that \^\{g)\ < ^(5)- For A = 
we have, by definition, equality. There are more class one representations tta, 
which arc obtained by taking A G 0* with < A < ^^^^ = p. (Here one 
has to change the inner product.) These are called the complem,entary series 
{spherical) representations. For X = p, tt\ is the trivial representation. The 
corresponding spherical functions ipx{g) satisfy the following estimate (see [GV, 
5.1 (5.1.18)]), for some constant C depending only on G : 

(10) \vx{g)\ < C(l + /3(loga(5)))e(^-'')i°s«(^). 

As the 7r;^'s are irreducible, having one matrix coefficient in L^{G) implies 
the same for a dense subset (linear combinations of G-translations) ; hence from 

(10) and (5) in Section 1 we get: 

(*) For A = |A|/3 (0 < |A| < \p\ = ^(5(G)), tta is strongly LP if 
p{y{G)-\X\)>S{G), i.e., p>2d{G)/6{G)-2\X\. 

Lower bounds on the spherical functions of complementary series repre- 
sentations will be needed as well. It turns out that these spherical functions 
are positive, and for some constant C' = C'{G) > (see [GV, 4.7 (4.7.13)]) 

satisfy: 

(11) c'/g(A-p)loga(a) < ^^(^^ p/2<X< p. 

By the reference cited above, (11) holds for every < A, with C' depending 
on A (when A = 0, C = 1, see [GV, 4.5]). Actually (11) holds for all < A < p. 
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but we have not found an easy reference for that. For A > 0, the ratio between 
the two sides of (11) tends to a positive bounded hmit when g — > oo, so (11) 
reflects the true asymptotics of (p\. This fact will be of considerable importance 
to us later (sec (1) in step (ii) of Theorem 4.2 below, and the remark thereafter). 

The above principal and complementary series representations exhaust all 
the class one irreducible representations of SO(n, 1), SU(n, 1). The existence 
of the whole continuous strip of complementary series representations is special 
to these two families of groups, and will be essential for the proof of Theorem 
2.1, to which we can now turn. 

IV. Proof of Theorem 2.1. 

1 =^ 2. Consider first the case p = 2. By a general result in [CHH] 
(which applies to any G, not necessarily a simple Lie group), it follows that vr 
is weakly contained in the regular representation. The bound (6) then follows 
from Theorem 2.2, Proposition 2.5 (with M = G), and the bound (9) for the 
Harish- Chandra S-function (which is taken as F{g) in Proposition 2.5). The 
constant C obtained here is the same as in (9). In general we will show that 
this C can be multiplied by at most 1/C ^, where C is taken from (11). 

We may assume that 2 < p < oo. Let q be the value for which | + | = ^• 
Let us assume first that p < 4, which means > 4. Take A for which the 
spherical function ip\ is in L'^~^^{G) for all e > 0, but not in L'^{G). This, 
in light of estimates (10), (11), singles out the A satisfying g(p — A) = 2p. 
Moreover, tt\ is strongly L"? (see (*) above). As > 4, we have A > p/2. 
Consider now the tensor product tt^ttx. For every fi, W2 in the assumed dense 
subspace of vr, and ui,U2 in the dense subspacc of vectors with L^"*"^ matrix 
coefficients in it\, wc have by the choice of q and the Holder inequality: 

{{iT(Si'n:x){g)vi(SiUi,V2'SiU2) = {'n{g)vi,V2) ■ {T^\{g)ui,U2) € for all e > 0. 

Since this holds also for sums of tensors Vi0Ui, and these form a dense subspace 
of the representation space for vr tta, we deduce that tt ® tta is strongly L^. 
The case p = 2 at the beginning of the proof, yields now the inequality (6) 
(with p = 2) for all iC-finite vectors in vr (8> tta • 

Let now u, w be any X-finite vectors for the representation vr, and let vx 
be the unit K-invariant vector in ttx. Then wSiVx, w0vx are K-finite vectors 
for TT (8) vr^, with dimxiu vx) = dim^ u and dimx(w vx) = diniK w. By the 
above discussion we get, assuming u and w are also normalized: 



\{Tr{g)u,w)\ ■ \{ttx{9)vx,vx)\ = {{{n ^ iTx){g)u vx,w vx)\ 
< C ■ (1 + /3(loga(5)))e-''('°s"(»» • {dimKuf^ ■ {dimKwf^. 

From this and (11), we now deduce: 

\{n{g)u,w)\ < ^(1 + P{loga{g)) ■ e-^(i°safe)) . (dim^ix)^^ . {dimKw)'/^. 
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To see that this is indeed the required estimate, it only remains to verify that 
^^^^(= y) = A. Since A and p are (nonzero) multiples one of the other, the 
ratio ^ makes sense, and we have to show that | = As A was chosen such 

that I = , the desired equality ^ = ^ is equivalent to ^ + ^ = ^ + = \ , 
which is exactly how q was chosen. This completes the case p < 4. 

If p > 4 take again q with i + i = i Now 2 < o < 4, so t = 2(7 > 4. Let 
A' be such that the spherical function ipx' is "exactly" in L^^'^{G) (again, see 
(*) above). Then p/2 < A', and we may repeat the whole previous argument, 
replacing tta with -Ky ® iry (which is strongly L'^ by Holder) , and the vector v\ 
by v\i ® vx . The argument proceeds similarly, with the one observation that 
the constant may increase up to C/C"^ . This completes the proof of 1 2. 

2 =^ 4. An argument identical to that in the first part of the proof 
of Proposition 2.5, shows that the iiT-finite matrix coefficients of a satisfy the 
same estimate (6). By (5) it is easy to see that they are in LP^^ for all £ > 0. 

4 =^ 3. If TT = JvTa; then, as is well-known, for almost every x the 
representation t^x is weakly contained in tt; so this implication is obvious. 

3 =^ 1. Taking a trivial decomposition tt = tt, we see that this claim is 
again obvious. 

Finally, if some nonzero v e H satisfies {■K{g)v,v) G LP+^(G), then by 
invariance of Haar measure it is easy to sec that the matrix coefficients of any 
two vectors in the (algebraic) span of tt{G)v have this property, a subspace 
which is dense by irreducibility. This completes the proof of Theorem 2.1. □ 



V. Unitary representations and discrete subgroups o/ SO(n, 1), SU(n, 1). 
The notion of critical exponent (see Definition 1.0 above) plays a central role 
in our discussion. This and other related notions such as the limit set and its 
Hausdorff dimension are covered, e.g., in [Ni]. Useful information concerning 
the relation to spectral analysis appears in [Cor], and some extensions to gen- 
eral CAT(-l) spaces can be found in [BM] (and the references therein). For 
the benefit of the reader, we collect here some basic properties of the critical 
exponent, which are used in the sequel. 

2.7 Lemma. Fix n > 2. Retain the notation in Definition 1.0 and the 
discussion preceding it. 

(1) If r is a lattice in G = SO(n, 1) then S{T) = n — 1. If it is a lattice in 
G = SU(n, 1) then S{T) = In. 

(2) If A < G then (5(A) < 5(G). If equality holds and A is geometrically finite, 
then A is a lattice. 
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(3) // G is as in (1) and A < G is a discrete nonamenable subgroup, then 
for every e > there is a free subgroup {say, on two generators) F < A, 
satisfying S{r) < e. 

Proof. We remark first on the initial statement of (2). In [BM, §1] the no- 
tion of critical exponent is extended naturally to any (not necessarily discrete) 
closed subgroup of the isometry group of a locally compact CAT(-l) space. 
The discussion there, Lemma 2.8 below, and the expression (5) for the Haar 
measure, show that our formal notation for d{G) in (3) above, indeed agrees 
with the general geometric definition of the critical exponent. In particular, 
the first claim of (2) follows from [BM, Lemma 1.5]. Next, for a geometri- 
cally finite subgroup A < G, the bottom of the Laplacian spectrum on the 
locally symmetric space A\G/K is achieved in the discrete L^-spcctrum (sec 
[Su2, 2.21], [Cor, §4]), and by its relation with the critical exponent (see the 
proof of Theorem 2.10 below), we have that (5(A) = d{G) if and only if is an 
(L^-)eigenvalue of the Laplacian, which happens if and only if A is a lattice. 
This accounts for (1) and the other direction in (2). For part (3) we pick, 
using the nonamenability of A, two hyperbolic elements of it, say a, b, whose 
attracting and repelling points on the boundary G/P are all different (their 
existence follows easily from the nonamenability of A). As is well-known (by 
Tits' "ping-pong argument"), for n large enough a" and 6" generate a free 
group. Using the fact that the metric contraction of a" and 6" on "most" of 
the boundary grows linearly with n, an elementary argument shows that the 
Hausdorff dimension of the limit set of the group generated by a" and 6" is 
dominated by some constant multiple of n~^. Since that dimension always 
bounds the critical exponent from above (cf. [BJ]), the result follows. □ 

2.8 Lemma. Let a : G ^ be as defined in (2), and let (3 be the positive 
simple root as before. Then for every g E G, 



Proof. The equality (12) is well-known and easy to verify. Briefly, notice 
that both sides of (12) are bi-iir-invariant functions on G, and thus depend for 
their value on A'^ . On A'^ both sides are additive characters, so that there 
is only an issue of normalization. This may be checked by one example, say, 
in the two dimensional real hyperbolic space. Another way the reader may be 
convinced, is to recall that the inverse of the exponential of the two expressions 
in (12) is in LP{G) for the same (open) set of p's, the infimum of which is S{G) 



(12) 



d{go,o) = /3{loga{g)). 



(see (3), (5)). 



□ 
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The following consequence illustrates in a simple but useful way, the con- 
nection between critical exponents and the notion of strongly representa- 
tions. 

2.9 Corollary. Let T < G = SO(n, 1), SU(n, 1) be any discrete sub- 
group, 2 < p < oo, and w be a unitary G-representation which is strongly LP. 

Then 7r|r is strongly L^^ . 

Proof. By 2 of Theorem 2.1, the K-finite matrix coefficients of tt satisfy 
the exponential decay estimate (6); thus by (12) each one is dominated by 
(a constant multiple of): 

e(-^+^)/3(loga(9)) ^ 

By Definition 1.0, the function on the right-hand side, when restricted to F, 
lies in L*(r) for every q > once £ > is chosen sufficiently small. □ 

Another relation between critical exponents and strongly LP representa- 
tions is obtained by: 

2.10 Theorem. Let T < G be any discrete torsion-free subgroup. Then 
the regular G-representation on L^(G/r) is strongly LP for 

p = max{2, 5{G)/5(G) - 5{T)}. 

Lf p > 2 this estimate is sharp: L^(G/r) is not strongly for q < p. 

Proof. Let us first consider the class one spectrum of tt = L'^{G/T), par- 
ticularly, the complementary series representations ttx, < X < p, which arc in 
the support of the spectral measure fi of the decomposition ir = J TTxd^{x) 
into irreducibles. Harish-Chandra has shown that the class one represen- 
tations TTx which occur in the decomposition, correspond (through the ac- 
tion of the Casimir operator) to the L^-spectrum of the Laplacian A act- 
ing on the locally symmetric space K\G/T. More precisely, denoting by vr;^ 
(0 < A < IpI = 6{G)/2) the representation irxg, then this representation lies in 
the support of jj,, if and only if |pp — A^(= (5(G)^/4 — A^) lies in the spectrum 
of A (see e.g. [Cor, §4] and the references therein, for this and other related 
results which are indicated without proof). On the other hand, the bottom 
of the spectrum of A may be precisely computed in terms of the critical ex- 
ponent 5{T): it is equal to S(T){6{G) - 6{T)) if 5{r) > and to {^)^ if 
(5(r) < (see also [Su2, 2.17]). In the second case we get that only principal 
series spherical representations can appear in L^(G/r), whereas in the first, 
complementary series representations do appear, but only for 

A < ^^-^-6{TmG)-6{T))P = ^(5(r)-^)2/3 = {6{T) - ^)/3. 
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Therefore, all the i^-invariant unit vectors v\ in these tta's satisfy by (10) the 
estimate: 

(13) \{7rx{9)vx, v^)\<C-{l + P{loga{g)) ■ eWr)-5(G))/3iog{a(s)), 

(Recall that 2p = 6{G)p.) If d{r) < 5{G)/2, by (9) we replace in (13) 6{r) by 
6{G)/2. 

Next, let V be any if-invariant unit vector in L^{G/T). Then by decompos- 
ing 7T = J 7TxdiJ,{x) we deduce that v = f Vxdn{x), where each Vx is (a multiple 
of) an appropriate v\, and thus the associated matrix coefficient satisfies the 
decay estimate (13). A simple direct integral computation then shows that (13) 
must hold also for v. We have thus established a uniform decay estimate for 
all i^'-invariant vectors in L^(G/r), and we may apply Proposition 2.5 (with 
M = G/T) to get a corresponding estimate for all iT- finite vectors. Finally, 
by (5) we see that the right-hand side of (13) is in L^(G) for every p such that 
p{5{G) - 5{T)) > (5(G); that is, L'^iG/F) is strongly LP for p = s(G)-5{r) ■ 
case S{T) < S{G)/2, it follows that this representation is strongly L^. 

The last claim of Theorem 2.10 follows from the fact that the above value 
of the bottom of the Laplacian spectrum is sharp, estimate (11) for the spher- 
ical functions, and 3 in Theorem 2.1. □ 

3. Cohomology of unitary representations 

I. Notation and some basic properties. Let G be a locally compact group 
and {tt,H) a (continuous) unitary G-represcntation. Denote by Z^(G, tt) the 
vector space of continuous G-cocycles with values in tt, namely, the continuous 
functions b : G ^ Tl satisfying: 

(1) b{gh) = b{g) + TT{g)b{h) for all g,heG. 

The subspace of co- boundaries: b{g) = 'K{g)v — v for some v G H, is denoted 
byS^G,^). 

3.1 Definition. The first cohomology group of G with values in vr is the 
quotient space: H^iG^n) = {G , n) / B'^ {G , n) . 

Given a cocycle b € Z^(G,7r), one can deform the linear action tt to an 
affine isometric action of G on More precisely, define an action p of G on 
Hhy: 

(2) p{g)v = Tr{g)v + b{g). 

Conversely, any affine isometric G-action on a Hilbert space H is easily 
seen to be obtained by a cocycle on the linear part of the action (see e.g. 
[HV, pp. 45-46] for this and other facts indicated below without proof). The 
following simple and basic fact will be useful: 
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3.2 Lemma. Let tt, 6 and p be as above. Then b G B^{G,7r) if an only if 
the associated G- action p has a fixed point. 

We shall also need the following well-known fact (see [HV, §4.3]): 

3.3 Lemma. For any isometric group action on a Hilbert space, the fol- 
lowing are equivalent: 

(i) The action has a fixed point. 
(h) Every orbit of the action is (norm) bounded. 
(in) There exists one (norm) bounded orbit. 

XL Restriction of cohomology: Proof of Theorem 1.12. We now come to 
the first main result of this section. In [Sh4] it is proved in a more general 
framework for any isometric action of a simple algebraic group over a local 
field, on a CAT(O) space. As it will be essential to us on many occasions in 
the sequel (sec [Sh4] for other applications), we include a short proof here for 
the more restricted result, sufficient for our purposes. 

3.4 Theorem. Let G be a simple Lie group with finite center, locally iso- 
morphic to either SO(n, 1) or SU(n, 1) (n > 2). Suppose that G acts continu- 
ously by isometrics on a Hilbert space H, without fixed points. Then the action 
is proper, namely, for every v EH and a sequence gi — oo, one has \\giv\\ — ^ oo. 
Ln particular, in light of 3.2, for any noncompact subgroup A < G and any uni- 
tary G-representation tt, the natural restriction map H^{G,'k) i?^(A, ttIa) 
is infective. 

Proof. Let us first prove the result in the case G = SL2(M). We assume 
that the action is not proper and show that it admits a global fixed point. 
Suppose then that for some v e H, gi ^ oo, and M < oo, one has \\giv\\ < M, 
or actually, what is more convenient for us, \\giV — v\\ < M. Consider the polar 
decomposition: SL2(M) = KA+K, where K = S0(2) and A+ = diag(a,o-^) = 
{(a)} with a > 1. Decomposing gi = ki{ai)k'-, a standard argument using the 
compactness of K shows that we may assume without loss of generality that 
9i = {o-i) G with Oj — > oo. Let N denote the upper triangular unipotent 
subgroup, and fix some n G N. Then (ai)~^n(aj) — > e; hence for all i large 
enough we have \\{ai)~^n{ai)v — v\\ < 1, and 

||n(aj)i; — < ||n(ai)v — (ai)f || + IKaj)-?; — ■u|| 

= \\{ai)~^n{ai)v - v\\ + \\{ai)v -v\\ <l-\-M. 

Next, write ||n(aj)?; — w|| = ||(ai)f — n"-^?;!! and repeat the same argument, 
to get \\v — n~^v\\ = \\nv — v\\ < 2M + 1. It follows that the action of AT on H 
has a bounded orbit and hence, by Lemma 3.3, admits a fixed point w. 
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The last part of the proof (still, for SL2(M)), is reminiscent of the so called 
"Mautner phenomenon" : one shows that any iV-fixed point in H must be fixed 
by G. Indeed, let w be as above and consider the function ip{g) = \\gw — 
Then ip is continuous, invariant under N, satisfies (p{g) = (p{g^^) for all g £ G, 
and has the property that (p{g) = if and only if gw = w. The argument in 
[Lubl, Lemma 3.1.13] shows that every such function must be identically zero 
on G; that is, w is indeed fixed by G. 

Let us return to the general case. Let G be (locally isomorphic to) SO(n, 1) 
or SU(n. 1), and let < G be a copy of (a finite cover of) S0(2, 1) ^ PSL2(M). 
The above proof for SL2(M) works for any finite cover of it, hence holds also 
for H. Recall that H and G share a mutual Cartan subgroup A. Thus, if for 
some sequence gi oo, and v £ TC, we have \\giV — f || < M, by writing a 
polar decomposition gi = kiUik'j^, we deduce that \\aiV — v\\ is bounded, and the 
-ff-action on 7i is not proper. By the first part of the proof, H fixes a point in 
H. In particular, every orbit of H is bounded (see Lemma 3.3). Let K he a 
maximal compact subgroup of G, such that the polar decomposition G = KAK 
holds, and let w G be a point fixed by K. Then, since ||ait; — w\\ < M for 
some M < oo and every o G ^4, we have \\k1ak2w — w\\ = \\aw — w\\ < M, so 
that \\gw — w\\ < M for all g G G. By Lemma 3.3 we conclude that G admits 
a fixed point in H. □ 

III. The induction operation on the first cohomology. An important no- 
tion in representation theory is that of induction. We shall now discuss this 
operation in relation to the first cohomology, and our main concern will be the 
more subtle issue of nonuniform lattices. 

To begin however, let G be any locally compact group equipped with 
Haar measure /it, and let F < G be a discrete subgroup. Given a unitary 
F-representation {tt,TI), recall that the (unitarily) induced G-representation 
Indpvr is defined as follows: The representation space for vr is the space of 
measurable functions f:G—>Ti. satisfying the two properties: 

/(57) = 7r(7)-V(5) for ah 7 G F and a.e. 5 G G, ^ ||/(5)f < cx). 

G/r 

The group G operates from the left: gf{x) = f{g~^x). An equivalent way to 
define this construction is as follows: Let X be a fundamental domain for G/F, 
i.e. G = XT. Then we identify X with G/F and let a: G x X ^ F denote the 
associated cocycle: 

(3) a{g, x) = 7 if and only if gx^ G X. 

Then the induced representation IndpTr may be identified with the space 
L'^{X,H), where the G-action is given by: 

(4) gf{x) =Troa{g~^,x)f{g~^ -x). 
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We have put the dot notation in g^^ ■ x to emphasize that this multiphcation 
is the G-action on X = G/T, but we suppress this notation henceforth. 

Next, we examine the induction operation on the first cohomology. Let 
b G Z^{r, tt) and consider, for every g E G, the function h:G ^ Indpvr defined 
by: 

(5) h{g){x) = ho a{g~'^,x). 

Since b is measurable on G. it is in fact continuous (this will also become 
evident in the geometric interpretation we presently give). It is easy to verify 
that (5) satisfies the formal cocycle identity (1), and we shall return to it 
shortly; however, one first has to check the integrability condition: 

(6) j \\h{g){x)fdii{x) < oo for all geG. 

X 

If we assume that T is co-compact, then for a choice of bounded X, (6) is 
obvious. Indeed, the cocycle a, hence also b{g), is bounded (as a{g,x) takes 
only finitely many values for every geG). Condition (6) for nonuniform 
lattices will occupy our attention shortly. 

Using the connection between cocycles and isometric actions (2) , we may 
present the situation in a more geometric framework. Starting with an affine 
isometric action p of F on a Hilbert space Tl, whose linear part is tt, consider 
the induced isometric G-action on L^(X,7i), given by: 

(7) gf{x)=poa{g'^,x)f{g'^x). 

As in (4), it is easily verified that this is indeed a G-action, and recalling that 
p('j)v = tt{'j)v + 6(7), we see that: 

gf{x) =7:oa{g'^,x)f{g'^x) + boaig'^,x). 

Thus (5) indeed describes a cocycle b for the induced representation Indpvr. 
The integrability condition (6) is equivalent to the condition: 

(8) J \\poa{g-\x)f{g-^x)fdn{x)<^. 

X 

Notice that (8) does not depend on /, as once it holds for some function 
/i G L^X,ny, the fact that / \\gf - gfifdfi{x) = J \\f - fi\\^dfi{x) < 00 

X X 

shows that it holds for every other / G L'^{X,H). We may thus choose any 
test function /, and a natural one would be the constant function f = o (which 
immediately reduces (8) to (6)). An equivalent, but more convenient way for 
us to present condition (6) (or (8)) is thus: 

(9) J \\p o a{g~^,x)o\\^dfj,{x) < 00 for all 5 G G. 
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Suppose that T is finitely generated, and let S* < T be a finite gen- 
erating set. Let £ = ^5 be the corresponding word length on F. Denote 
M = m8ix{\\p{'j)o\\ I 7 € S}. Then successive iterations of the triangular in- 
equality easily show that for any 7 € F one has ||/5(7)o|| < M ■ -^(7). It follows 
that in order to verify condition (9), it is enough to verify: 



X 

a condition which depends now only on F and G, and not on the representa- 
tion TT. 

3.5. Before discussing (10) for nonuniform lattices, let us assume for the 
moment that for some F < G it holds. We shall prove that this implies The- 
orem 1.10, by showing that the map b ^ b induces an isomorphism between 
the first cohomology groups. That (5) induces a (linear) map on the first co- 
homology groups H^{T,7r), i?^(G, Indpvr), namely, that it maps a coboundary 
to a coboundary, is trivial. We observe first that this map is injective. Indeed, 
by Lemma 3.2 the injectivity is equivalent to the following: If there exists an 
a-invariant L^-function for the G-isometric action, i.e., / G L^(X, 7i) with 
p o a{g^^ ,x)f{g^^x) = f{x) for all 5 G G and almost every a; G X, then there 
is a F-fixed point for its original action on H. This, however, is exactly what 
is shown in [Zil, 4.2.19] (even though in a somewhat different context). 

The issue of surjectivity of the map is less transparent, and here it is conve- 
nient to use the fact that G is a Lie group. Since the argument is standard, and 
we prove the surjectivity only for completeness (we will not be needing it in the 
sequel), we shall be brief. Given a unitary G-representation, (vr, Ti), wc denote 
by 7i°° the space of smooth (G°°) vectors, a space which is invariant under the 
action of G, its Lie algebra q, and the universal enveloping algebra U{g). Also, 
H°° is a continuous G-module with its C°° topology, which is equivalent to the 
topology defined by the semi-norms v — > ||-^?^||, X e U{q). It was shown by 
Pichaud (see [Pi, §4.1-4.2] for further related information, or [BW, p. 287] for 
cohomology in all degrees) that the natural map H^{G,Ti.°°) —>■ H^{G,TL) is 
an isomorphism. Hence, starting with any cocyclc b G Z^(G, IndpTr), in order 
to show that it lies in the image of the map in question, we may assume that 
it takes values in (Indp7r)°°. Assume for the moment that we show that any 
element in the latter space is a smooth function on the manifold G/F with 
values in H. Then the map 7 — > 6(7) (e) makes sense, and it is easy to check 
that it defines a cocycle b : F ^ H such that (b) = b. Finally, to show that 
a smooth vector is indeed a smooth function, it is enough to see that it is a 
weakly smooth function on G/F, which can be shown to follow from Sobolev's 
Lemma (cf. [Yo, p. 174]). 



(10) 




for all g E G, 
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IV. Induction of cohomology for nonuniform lattices: Proof of Theorem 
1.10. The rest of Section 3 is devoted to proving the following result for 
G = SO(n,l). 

3.6 Theorem. Ifn>4 and F < G = SO(n, 1) is any nonuniform lattice, 
then condition (10) is satisfied for an {appropriately chosen) fundamental do- 
main X. Consequently, by 3.5 above, for every unitary T-representation it, the 
map b ^b {given by (5)) defines an isomorphism H^{T,Tr) = H^{G,lnd^n). 

In the appendix, the following is proved: 

3.7 Theorem. Theorem 3.6 holds if SO(n, 1) is replaced by any other 
rank one simple Lie group. 

Of course, since the groups Sp(n, 1) and F^_2o) have property (T), we will 
not be interested in them here. Although basically, the same approach used to 
prove Theorem 3.6 applies to the other cases, the details become more involved, 
and require somewhat more sophisticated tools. As the proof of Theorem 3.7 is 
quite technical, we postpone it to the appendix, and concentrate here only on 
Theorem 3.6. The relative simplification in the proof of the latter comes from 
the fact that only for the real hyperbolic spaces one knows a "good" global 
description of the Riemannian metric, while in the other cases a more local 
analysis is required. 

We first make some general preliminary reductions, which will serve us in 
the proofs of both theorems. Replacing F by a finite index subgroup, we may 
assume that T is torsion free. Let K < G he a maximal compact subgroup 
and choose a fundamental domain Y for the T (right) action on G, which is 
if-invariant. Then for every k e K, one has a{gk,y) = a{g,ky), and since 
y ky is measure preserving, we deduce that the integral expression in (10) 
is invariant under the map g gk. Furthermore, if fc G 5 € G, 7 G F and 
y E Y satisfy gyj G Y, then also kgyj G Y, so that a{kg,y) = a{g,y). It 
follows that (10) is also invariant under left if-multiplication. Hence by polar 
decomposition, it is enough to establish (10) when g = at € A (see (1) in §2.1). 

Let M be the centralizer of ^ in K. Since A commutes with M, its 
(left) action on G/T induces an action on M\G/T. Recall that the fundamen- 
tal domain Y is K-invariant, and in particular M-invariant. For all y G Y, 
m G M,at G ^,7 G F we have atmy^ = matyj, so that a{at,my) = a{at,y). 
Thus, as far as the ^-action is concerned, we may safely replace G through- 
out the following by M\G and denote, still by Y , a fundamental domain for 
the (right) F-action on the latter. Recall now that M\G may be identified 
with the unit tangent bundle of the symmetric space K\G. With this iden- 
tification, the left ^-action on M\G is no more than the geodesic flow on 
T^{K\G). Denoting by p: M\G K\G the natural projection, and by d 
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the usual G-invariant Riemannian metric on K\G, we thus have (with an ap- 
propriate normahzation): d{p{aty) , p{y)) = t. The map p is F-equi variant; 
hence F = p{Y) is a fundamental domain for the right F-action on K\G, 
and for 7 G F, wc have atyy G y if and only if p{aty)j G F. Now, no- 
tice that the set oi g G G, for which condition (10) is satisfied, is closed 
under multiplication (indeed, with notation as in the beginning of §3.111, write 
WghfW < Wghf - 5/11 + \\gf\\ = \\hf -f\\ + m < \\f\\ + \\hf\\ + \\gf\\). Thus, 
we may consider only at for — 1 < t < 1, and together with the foregoing 
discussion, we are now reduced to establishing the following result: 

3.8 Theorem. With the notation above, for every x G K\G let w{x) de- 
note the word length of the element 7 G F {with respect to some fixed generating 
set of F), for which G F. The function w takes only finitely many values 
on any compact subset C {since C meets only finitely many T-translates of F), 
and let f{p) = sup{'w{x) \ d{x,p) < 1}. Then f\F € L^{F) with respect to the 
Riemannian volume on F G K\G. 

As mentioned, wc discuss here only G = SO{n, 1), and in the appendix 
also G = SU(n, 1), Sp(n, 1). First, we need to recall some fundamental results 
of Garland-Raghunathan [GR] concerning the structure of some fundamental 
domains for nonuniform lattices in rank one Lie groups. 

Let F be such a lattice. Then a fundamental domain for the F-action 
on K\G can always be chosen to consist of finitely many cusps. Since their 
number is finite, it is enough to show the L^-integrability of / on each one, 
so we confine our discussion hereafter to studying the behavior of / on one 
such cusp The direction of the cusp fl is determined by one geodesic ray, 
which without loss of generality may assumed to be given by oA^ = o{at), 
where o = e G K\G, and at is as in (1) of Section 2. The cusp group, namely, 
the group which fixes this geodesic ray, is the group P = MAN (see 2.1). The 
group A?^ n F is cocompact in N. 

Let us specialize our discussion henceforth to G = SO(n, 1). Then we 
have N = W^^^, so n F = Z"^^. Choosing a bounded fundamental domain 
r(^ [0, l)"-i) for AT n F in N, we have Q = o • iat)t>oT (see [GR, Th. 0.6]). 
We shall now need to recall the more concrete (and well-known) description 
of the real hyperbolic space H" = K\G. Recall that in the upper half space 
model, H" is represented by n coordinates (xi,-- - ,x„_i,e*), with Xi,t G M, 
and the hyperbolic length element is given by: 

, 2 d^i + dxl_-^ + e'^^dt^ 

(11) ds^ = — 



e2t 



These coordinates are induced by the Iwasawa decomposition, G = KNA, 
where N = W^~^ = {xi, • • • , Xn+i, 1) and 

^ ^ M* = (0, 0, • • • , e"*) (o = (0, ...0, 1)). 
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The G-Haar measure in the Iwasawa coordinates is given by (see [GV, 2.4.2]): 
dg = e'^^^^°^°'^dkdnda, where dk is the K-Haar measure, dn = dxi---dxn~i 
is the R^^^-Haar measure, and da is the Haar measure of A, which, when 
written additivcly through the exponent change of variable, is just the Lcbcsgue 
measure dt. Since p{log a) = {n — l)t, we have for the volume element on K\G: 

dxi ■ ■ ■ dxn-idt 

(12) dv = . 

For a point y = {xi, - ■ ■ , a;„_i, e*) G H" call t = h{y) the height of y. 

Let us now return to the proof of Theorem 3.8, concentrating on the cusp 
above. It is easy to see that if p G has height large enough, then for any 
point X with x) < 1 the element 7 € F such that x'j & F actually satisfies 
X7 G and belongs to N. Since we may assume that the generating set 5 C F 
contains the standard generators for the lattice FfliV = Z"'"^, (11) shows that 
a bound on the difference between the first n — l coordinates of p and x yields 
a bound on ^(7). This and (11) imply that /(p) (defined in 3.8) is dominated 
by some constant multiple of the square root of the denominator of (11) at p, 
namely, by Ce^^\ Therefore, using (12) we get: 

00 00 

lfmv<c I «-<p)*<c/a-<»-.)'* = c/.<-).*. 

n TxA+o 

For n > 4, the last integral converges. This completes the proof of Theo- 
rem 3.6. □ 



4. The invariants p{G) and p(F) 



I. p{G): Proof of Theorem 1.9 for simple Lie groups. Although our inter- 
est in the present paper lies in the first cohomology, one may consider higher 
cohomology groups, which are of interest in their own right, and have some 
applications in the spirit of those presented here (these will be discussed else- 
where.) We refer the reader to [Gu] for the general definition of the cohomology 
groups if"(G, y), for any locally compact group G, and a G- module V. One 
can thus extend Definition 1.8 of the introduction as follows: 

4.1 Definition. Let G be a locally compact group and n > 1. Define 
Pn{G) =inf{l < p < oo\ there exists a unitary G-representation tt 
which is strongly L^, and satisfies i?"(G, tt) ^ 0}. 

As in Definition 1.8, if there is no tt with i7"'(G, tt) 7^ 0, set Pn{G) = 00. 
For consistency with Definition 1.8, we set p{G) = pi{G). The main result of 
this subsection, and one which is fundamental in the sequel, is the following: 
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4.2 Theorem. Suppose that G is a connected simple Lie group with finite 
center, locally isomorphic to SO(n, 1) with n > S, or to SU(n, 1) with n > 2. 
Then p(G) = 5(G) {see (3) in §2.1 for the numerical values). 

The proof of Theorem 4.2 is based on the classification of relative Lie al- 
gebra cohomology of (g, i^)-modules, and its scheme may be used to compute 
(or at least estimate) Pn{G) for any simple Lie group G and n > 1. Follow- 
ing the proof of the theorem we shall remark on the general case, and some 
fundamental differences which arise when n > 1. We shall also indicate a 
simpler, but more restricted, approach, suitable for the first cohomology and 
the groups SO(n, 1) only, avoiding completely the use of (g, if )-modules and a 
classification. 

Proof of Theorem 4.2. We assume that G is not locally isomorphic to 

SL2(M)(^ S0(2,l) ^SU(1,1)), 

a group which is discussed in Theorem 4.3 below. The proof is carried out in 
several stages. 

(i) Classifying the irreducible representations tt with nontrivial cohomol- 
ogy. The first step is the correspondence between continuous and relative Lie 
algebra cohomology for the associated {q,K) module of if -finite vectors (car- 
ried out through the smooth cohomology) ; see [BW] or [Gu] . Once transferred 
to this framework, one uses the classification of (irreducible) (g, if )-modules 
with nontrivial cohomology. It turns out that SO(n,l), n > 3, has exactly 
one irreducible representation with nontrivial first cohomology, and SU(n, 1) 
has two such representations (conjugated under an outer automorphism of the 
group). This result is due to Delorme (see [De] and the references therein), 
and Hotta-Wallach [HW] , but explicit constructions of the representations were 
known previously, at the Hilbert space level (see [GGV]). The classification in 
terms of Langlands parameters is, as we shall see, adequate for our purposes; 
see [BW, Ch.VI §4] for a complete discussion of SO(n, 1), SU(n, 1) (or p. 386 
therein for a quick survey). 

(ii) U'-integrability of K -finite matrix coefficients for the representations 
in (i). Once the Langlands parameters of an irreducible representation of a 
simple Lie group are known, one can compute the exponential decay along 
the Cartan subgroup A, of the if -finite matrix coefficients. Since we need to 
identify precisely the minimal p for which these matrix coefficients are in L^"*"^, 
and not just a bound, more should be said. 

If G is locally isomorphic to SL2(C) then (i) yields exactly one represen- 
tation (sec below), which turns out to be tempered; its if -finite vectors have 
matrix coefficients in L^+'^(G) for all e > 0, but since it is not from the discrete 
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series (which does not exist for SL2(C)), no matrix coefficient can be square 
integrable ([HT, Ch. V, 1.2.4]), so that p = 2 is indeed minimal. For the other 
groups, the classification shows that the representations found in (i) arc not 
tempered. The Langlands parameters (cf. [BW, Ch.VI Theorems 3.2, 4.5, 4.11] 
for S0(2fe + 1, 1), S0(2A;, 1), SU(ra, 1), resp.) yield for any such representation 
TT, and if-finite vectors v,w, the existence of a limit: 

(1) lim e^('°g'')|(7r(a)i;,u;)| = \L{v,w)\ < oo 

where L{v,w) is not always zero (it is a matrix coefficient associated with the 
representation of the compact subgroup M involved in the Langlands param- 
eters of vr); see [BW, p. 131] (and pp. 10, 126 therein for the notation), or 
[Kn, p. 198, Lemma 7.23]. Notice also that dim A = 1 is helpful here, for the 
clean expression in (1). By a standard argument (see (2) in §4.111 below), 
one shows, using the K-finiteness of v,w, that there is C < oo such that the 
expression inside the limit (1) is bounded by C if Tr{a) is replaced by n{g), 
and logo by \og a{g) (defined in (2) of §2.1), for any g ^ G. This, together 
with the expression for the Haar measure in terms of polar coordinates (see 
(5) of §2), shows that for p = d{G), the K-Hnite matrix coefficients are all in 
IP+'^i^G) for all e > 0. We should perhaps remind the reader that the repre- 
sentations obtained in the form of Langlands parameters are not unitary in 
general, only (irreducible and) admissible (in our case, they will be unitary 
exactly for G = SL2(C)). However, the ones we discuss are infinitesimally 
equivalent to a unitary (irreducible) representation, and infinitesimally equiv- 
alent admissible representations have the same set of matrix coefficients, which 
is all we are interested in here (see [Kn, p. 209, p. 211 Cor. 8.8]). 

Now, to show minimality of p, notice that if there exists a if-finite matrix 
coefficient in L^{G) for some r < (5(G), then applying Theorem 2.1 (2) and then 
[Co2, p. 157 Cor. 2.2.4], yields a contradiction to the nonidentically vanishing 
of L{v,w) in (1). This completes step (ii). We only remark that a more subtle 
question is whether the above matrix coefficients are not in L^'^'^\ but only m 
j^S{G)+e_ rpj^-g indeed the case, and would refine our geometric applications 
if it could be shown to hold in the more general situation discussed in step (iv) 
below (compare with the proof of the second part of Theorem 1.5, in §5.11, 
where this refinement holds and is used). However for our purposes here, this 
issue does not arise, as the definition of p{G) considers the infimum of p's, 
which will be S{G) regardless of such a refinement. 

(iii) U'-integrability of all matrix coefficients for the representations in (i). 
Recall that since we are still dealing with irreducible representations, having 
one or a dense set of L^-matrix coefficients is equivalent. By Theorem 2.1 it 
follows that the same p computed in step (ii) is the minimal value for the 
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integrability of all the matrix coefficients (there might be matrix coefficients 
lying in 1/^'^^ rather that in U'^^^'^^ for all e > 0, but as remarked in (ii) above, 
this has no bearing on the computation of p{G)). 

(iv) Passing from irreducible to general representations. If G is a locally 
compact group and tt = /^tTj; is a direct integral decomposition into irre- 
ducibles, it is in general possible that tt is strongly for some p < oo, but 
none of the tTx have this property (e.g., G = M, vr = L'^{G)). The situation 
with simple Lie groups is different, and from Theorem 2.1 we moreover get the 
sharp result required for the groups of interest to us; as long as p > 2, almost 
every t^x is strongly for the same value of p. 

Next, consider a direct integral decomposition n = j tTx, and suppose 
that H^{G, tt) 7^ 0. It is not true in general that for a set x of positive measure 
one must have H^{G, tTx) ^ 0. However this is true, by a result of Guichardet, 
if we replace with the reduced cohomology (cf. [Gu, Ch.3, §2] for the 
precise notions and results, and also the proof after Theorem 1.7). It is easy 
to see that coincides with if the representation tt does not weakly 
contain the trivial representation (cf. [Sh2, 1.6]). However, every strongly 
LP representation {p < oo) of a nonamenable group has the latter property. 
Briefly, this follows by examination of the n-fold tensor power c = tt" for some 
integer n > p/2. Using Holder inequality, one shows that a is strongly L^; 
hence by [CHH] it is weakly contained in the regular representation. But if tt 
contains weakly the trivial representation, then so does a, which together with 
the previous argument shows that the same holds for the regular representation, 
contradicting nonamenability (see e.g. the proof of Theorem C in [Sh3]). We 
can now deduce from this and the foregoing discussion, that if tt = J® tTx 
is a representation of G = SO(n, 1) or SU(n, 1), which is both strongly LP 
{2 < p < oo) and satisfies H^{G,'ir) ^ 0, then there is an irreducible tTx with 
the same properties; so by (iii) we have p > S{G). This completes the proof of 
Theorem 4.2. □ 

Let us say a few words concerning the situation for a general simple Lie 
group with finite center G, and all values of n, when estimating the value of 
Pn{G) in Definition 4.1. The general problem of describing all unitary rep- 
resentations with nontrivial cohomology (in all degrees), for any simple Lie 
group G, is a well-studied one. It is known that for any G, only irreducible tt 
for which the center of the universal enveloping algebra acts as in the trivial 
representation, may have i?"(G,7r) ^ for some n, and that these are finite 
in number. Vogan and Zuckerman [VZ] established a general (but explicit) 
method of describing all such unitary representations, for any G (although the 
unitarity of all their constructions was proved only later by Vogan). In [VZ] 
it is also shown how to locate the constructions in the Langlands classifica- 
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tion. Thus, the problem of classification is as much solved as one can expect, 
in complete generality, hence step (i) may be carried out in general. Next, 
as mentioned earlier, once the Langlands parameters are known, it is an easy 
matter to determine the exact decay of X-finitc matrix coefficients along the 
Cartan subgroup, thereby getting a sharp value for p in step (ii). Steps (iii) 
and (iv) reveal the fundamental differences which occur in this more general 
framework. Due to the lack of (knowledge of) Theorem 2.1 for other G's, we 
can only assert in general, using Cowling's "Kunze-Stein phenomenon" [Col], 
that the value of p may decrease up to the closest even integer in the process 
of passing to all matrix coefficients and all representations, thereby giving only 
an interval of length (at most) 2 for the value of Pn{G). Moreover, in the 
case n > 2, to pass from irreducible to general representations in (iv), one 
has to work originally with reduced cohomology, rather than the ordinary one 
(which requires more effort in a later stage, when transferring this property to 
lattices), or establish a general criterion, as the one we had for H^, relating 
the two notions. This strategy seems possible at least when n = Rank(G), 
however, we shall not pursue here further this direction. 

Before presenting a different approach to proving Theorem 4.2, let us 
consider the general case p{G) = 0, and in particular that of G = SL2(M). 

4.3 Theorem. For a locally compact group G, the following properties 

are equivalent: 

(1) p{G) = 0; 

(2) p{G) < 2; 

(3) HHG,L^{G))^0. 

If either G = SL2(M), orG is amenable and noncompact, then (l)-(3) are satis- 
fied. When G is a finitely generated nonamenable group, (l)-(3) are equivalent 
to nonvanishing of the first £^-Betti number. 

Proof. Clearly (1) ^ (2) and (3) =^ (1) (the regular representation has a 
dense set of matrix coefficients with compact support). The fact that 
(2) =^ (3) follows from a well-known result (cf. [HT, Ch.V, 1.2.4]): any unitary 
representation with a dense subspace of matrix coefficients which are square 
integrable, can be embedded in a multiple of the regular representation. We 
only remark that because matrix coefficients are bounded, L^-integrability for 
p < 2 implies square integrability, and that one has (G, oo • tt) 7^ if and 
only if H^iG,7r) 0. 

Since SL2 (M) has (two) discrete series representations with nontrivial first 
cohomology ([BW, Ch.VIj), (3) is satisfied. It is also satisfied by any amenable 
noncompact group, by a result of Guichardet [HV, p. 48] (every representation 
which contains weakly, but not properly, the trivial representation, has non- 
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vanishing first cohomology) . The last assertion is due to Bekka and Valette 
[BV]. □ 

We now turn to discuss a more ilhiminating approach to the proof of The- 
orem 4.2 for G = SO(n, 1), explaining better the connection between p{G) and 
5{G). We shall avoid classification, and give explicit geometric constructions 
of representations achieving the bound p{G). Some of the results established 
along the way will also be used in the sequel. 

4.4 PROPOSITION. For G = SO(n, 1), p{G) < (5(G). 

Proof. By Theorem 4.3 we may assume n > 3. Recall that many lattices 
(uniform and nonuniform) F < SO(n, 1) admit an amalgam decomposition 
r = A*c B, where C is a lattice in SO(n — 1,1). Constructions of such 
decompositions go back to Millson [Mi]. Explicit and well-known ones appear 
in [GPS], where the nonarithmetic lattices share this property virtually by 
their construction. It can be shown (see the discussion in §5.1 below), that for 
any group P and a decomposition T = A *c B, one has H^{r,£'^{r/C)) ^ 0, 
where C < C has index at most 2. Thus, taking a uniform lattice P, with an 
amalgam decomposition as above, we may induce the P-rcprcscntation I'^iT /C) 
to G, and from 3.5 deduce that {G , L? {G / G)) / 0. However, recalling that 
G is a lattice in SO(n — 1, 1), we have 5{G) = n — 1 — l = n — 2. Prom 
Theorem 2.10 it follows that L'^{G/G) is strongly hence by definition, 

p{G) < (5(G). □ 

4.5 Theorem. Suppose that G = SO(n, 1) or SU(n, 1), and that H is ei- 
ther a group of this type, embedded naturally inG {as described at the beginning 
of Section 2), or any infinite discrete subgroup. Then p{H) < |^p(G). 

Proof. Assume first that p{G) > 2 and let tt be a G-representation which 

S(H) 

is strongly for p > 2. Then 7r|// is strongly L^C^^^ (if H is discrete use 
Corollary 2.9; in the other case use Theorem 2.1 and expression (5) for the 
Haar measure). The result then follows from Theorem 3.4. If p{G) < 2, then 
using Theorem 4.3 and the fact that L'^{G)\h is a multiple of L^{H), we get, 
applying Theorem 3.4 again, that p{H) = p{G) = 0, as required. □ 

Remark. A posteriori, once we have established p{G) = (5(G) (or at least 
p{G) < 6(G)), it follows from Theorem 4.5 that p{A) < (5(A) for every infinite 
discrete subgroup A < SO(n, 1), SU(n, 1). 

4.6 Lemma. If G = S0(3,l)(^ SL2(C)) and T < G is a lattice, then 
p{G) > 2 and p{T) > 2. 
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Proof. If the conclusion fails either for G or for F, we have by Theorem 
4.3: H^{G,L'^{G)) + 0, Fi(r,£2(r)) ^ Q, resp. The first case is reduced to 

the second by restricting the regular representation (and using, say, Theorem 
3.4). However the second is impossible by [BV, Th. D], if we go back to the 
vanishing of the first ^^-Betti number for these lattices. □ 

4.7 Corollary. For G = SO(n,l), n > 3, p{G) > 6{G). Hence, by 
Proposition 4.4, p{G) = S{G). 

Proof. If n > 3 and p{G) < 5{G), then with H = S0(3, 1) in Theorem 4.5 
we get p(H) < S{H) = 2, which contradicts Lemma 4.6. □ 

4.8 Corollary. For G = SU(n, 1), n > 3, p{G) > 5{G). 

Proof. The argument is similar to that in 4.7, with H = S0(3, 1) < 
SU(n,l). □ 

The difference between the families SO(n, 1) and SU(n, 1), is that we are 
not aware of any natural construction of representations of the latter, as in 
Proposition 4.4, for which one easily verifies p{G) = S{G). 

II. p{T): Proof of Theorem 1.9 for lattices. The proof of the following 
result illustrates why it was essential to define p{G), when G is a simple Lie 
group, for an arbitrary dense subspace of matrix coefficients, and not restrict 
to K-hnite ones. 

4.10 Lemma. Let G be a locally compact group and T < G a lattice. If 
IT is a unitary T -representation which is strongly LP for p > 1, then IndpTr is 
also strongly LP. 

Proof. Let jjb be the Haar measure of G and X be a fundamental domain 
for r in G: G = XT. We normalize jjl such that ijl{X) = 1 and denote its 
restriction to X by nx- Let a:GxX^The the associated cocycle (see 
(3) in Section 3 - we shall use freely the notation of that section). Let Ti 
be the representation space for tt, and Hq C H the assumed dense subspace. 
It suffices to show that if ip,ijj:X Ho take only finitely many values, then 
{gif,'^) G LP'^^{G) for all £ > 0, as the subspace of those vectors is clearly 
dense. 

Let F = {ui} C -f^o be the (finite) set of vectors in the image of ip and 
and define for every 7 G F: /(7) = ^ |(7r(7)'Uj, Uj)|. By our assumption on 

TT it is clear that 7(7) G P^^iJ^) for all e > 0. Next, consider the measure A 
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on r pushed by a from G x X: A = x \ix)- In other words, A{7} is the 
/X X ^ix measure of all the pairs (5, x) G G x X for which a[g^ x) = 7. We 
claim that A{7} = a*(^ x fJ-x){'y} = 1, namely, that A is just the counting 
measure on T. To verify this it is enough, by Fubini, to show that for every 
fixed xq £ X, the set oi g £ G satisfying a{g,xo) = 7 has measure 1. Indeed, 
a{g, xq) = 7 44> gxoj £ X 4^ g £ Xj'^Xq-^. We can now compute: 

J \{gcp,^)\P+'dfx{g) = J I J{a{g-\xMg-'x),^P{x))dfXx{x)\P+'dfi{g) 
G G X 



I ( I \{a{g-\xMg-'xU{^))\d^ix{x)r+'d^^{g) 
G X 

-II \^'^^9-\xMg-'x),i^{x))\P+'diix{x)dii{g). 



< 

G X 



G X 

Making a change of variables: 7 = a{g~^,x), and recalling the definition of /, 
we may continue to complete the proof: 

< ^ filT^'dXi-f) < 00. □ 



Notice that for all discrete subgroups T < G = SO(n, 1), SU(n, 1), we have 
estabhshed an inequality p{T) < 6{T) < 5{G) = p{G) (by Theorems 4.2 and 
4.5). We can now show that for lattices equality always holds. 

4.11 Theorem. Let G be a locally compact group and T < G a uniform 
lattice. Then for every n G N, Pn(^) = Pn{G)- If T is nonuniform, then 
p{y) < p{G), and when G is a connected simple Lie group, p{T) = p{G) as 
well. 

Proof. For the inequality Pn{^) < Pn{G) (F uniform), one only needs 

to verify that the restriction of a strongly L^ representation from G to F is 
still strongly L^ (this holds for any closed subgroup F; sec [Ho, 6.4]), and 
that for a representation tt with if"(G, tt) 7^ 0, one has if"(F, 7r|r) 7^ 0. For 
the second claim, notice that for every uniform lattice F in a locally compact 
group G, (2) in Theorem 1.10 holds (cf. [Gu, 111 §4]). Since for every G- 
representation vr, one has lndp7r|r = vr (g) L^(G/F), and Iq C L'^{G/T), we 
have TT = vr (8) 1g C IndpTrjr; hence by (2) we cannot have iJ"(F, 7r|r) = 0. 
To show the opposite inequality PniG) < Pn(r), use again (2) from 1.10, and 
Lemma 4.10. 

If n = 1 and F is nonuniform, wc can repeat the argument above to 
show that p(F) < p{G). Just replace the use of (3) by [HV, 3.C.19] to show 
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nonvanishing. Finally, if T is nonuniform and G is a connected simple Lie 
group, the cases SO(n, 1) with n > 4 and SU(n, 1) with n > 2, follow by 
inducing the cohomological representation as above, by Theorems 3.6, 3.7. 
The case of S0(3, 1) = SL2(C) follows from Lemma 4.6, and that of 
S0(2, 1) = SL2(M) is trivial, as by Theorem 4.3 and the above discussion, 
we have < p{T) < p(SL2(M)) = 0. Since all other simple Lie groups have 
property (T), we have for them p{T) = p{G) = oo. □ 

in. First applications: Proofs of Theorems 1.1 and 1.5. We are now able 
to pick up the first fruits of our consideration of unitary representations and 
their cohomology. 

Proof of Theorem 1.1. As A and T are isomorphic, p(A) = p{T) = 5{T) 
(by Theorems 4.11 and 4.2). Since by Theorem 4.5 we have p{A) < (5(A), the 
result follows. □ 

Next, we prove Theorem 1.5 stated in the introduction, and discuss some 
further applications. 

Proof of Theorem 1.5. Assume first that A < G = SO(n, 1), SU(n, 1) is a 
nonamenable subgroup with S{A) < 2. From the remark after Theorem 4.5, it 
follows that p{A) < 2; hence by Theorem 4.3 the result follows. 

Assume now that 5(A) = 2. As in the previous case, it is enough to show 
that H^{A,£'^{A)) ^ 0, when we assume the Poincare series in Definition 1.0 
converges at s = 2. By enlarging G if necessary, we may assume that it is not 
SO(A;, 1) for = 2 or A; = 3. Recall now from the proof of Theorem 4.2 (see step 
(ii)) that G admits an irreducible unitary representation vr with H^{G,7t) 7^ 0, 
such that TT is not tempered. Hence X-finite matrix coefficients in tt satisfy 
along the asymptotic behavior described in (1) there. Let us extend the 
decay estimate given by (1) to all G in terms of the Cartan decomposition (this 
will become an upper bound, rather than precise asymptotics) . 

Let v,w be iC-finite unit vectors, and let vi, ...,Vn {wi, ...,Wm) be an or- 
thonormal basis for Sp&n{Kv} (Span{Kw}, resp.). As in the proof of Theorem 
2.5, for every k £ K there exist unique complex numbers Oi{k), . . . , 9nik), such 
that for all k £ K, Tr{k)v = J29i{k)vi. Obviously, for all i, \Oi{k)\ < 1. Sim- 
ilarly, let Ti{k), . . . ,Tm{k) be the complex functions corresponding to w and 
the basis wi, Wm- By (1) in step (ii) of Theorem 4.2 we know that there is a 
constant C < oc such that for all a G A'^ one has \{7r{a)vi,Wj)\ < C'e~^('°s"\ 
for all i,j. Given g € G, write g = kiak2 where a = a{g) G A'^ and ki,k2 G K, 
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and evaluate: 

(2) Mg)v,w)\ = \{Tria)Trik2)v,TTik^^)w)\ 

= \{'^ia)^0i{k2)vi,^Tj{ki^)wj)\ 

= \ ^ei{k2)Tj{k^^){TT{a)Vi,Wj)\ 

From Lemma 2.8 and (2) above we conclude that if the Poincare series 
in Definition 1.0 converges for s = 2, then all X-finite matrix coefficients of 
ttIa are in ^^(A). Since this is a dense subspacc, it follows ([HT, Ch.V, 1.2.4]) 
that ttIa is embeddable in a multiple of £^(A). However, from Theorem 3.4 we 
have H^(A,n\\) 0; thus oo ■ £^(A) has nonvanishing first cohomology, and 
the same holds for £^(A) (see Theorem 4.3), as required. □ 

As mentioned in the introduction, there arc various known results on van- 
ishing of the first £^-Betti number. The case of Kahlcr groups, mentioned in 
the introduction, is due to Gromov [Grl] (see [ABR] and [ABC, Ch.4] for a 
detailed discussion). Various other examples, including all known (and con- 
jectured) fundamental groups of closed prime 3- manifolds, were established by 
Liick [Lu]. Very recently, Gaboriau [Ga] showed (sharpening a result by Liick 
[Lu]), that the first ^^-Betti number vanishes for every group which admits an 
infinite index, infinite, finitely generated normal subgroup. Together with The- 
orem 1.5, this yields the following purely group theoretic consequence (which 
is a classical theorem of Schreier in the case of free groups): 

4.12 Corollary. Lei A<SO(n, 1), SU(n, 1) be a discrete, nonamenable, 
finitely generated subgroup, which is either of critical exponent less than 2, or 
a convergence group of critical exponent 2. Then every infinite, infinite index 
normal subgroup of A, is not finitely generated. 

Note that the result is tight, and fails in general for divergence groups with 
critical exponent 2. Indeed, many lattices A < SL2(C) are known to surject 
onto Z, with a finitely generated kernel. 

Finally, notice that from [BV] it follows that the family of discrete sub- 
groups of SO(n, 1) or SU(ra, 1) with critical exponent less than 2 (or groups of 
convergence type with critical exponent 2), provide, by Theorem 1.5, a new 
class of groups admitting nonconstant Dirichlet harmonic functions (with re- 
spect to any choice of finite generating set). For instance, by Lemma 2.7 (2) 
every geometrically finite subgroup A < SL2(C), which is not a lattice, satis- 
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fies a strict inequality 6(T) < 5(SL2(C)) = 2, and hence the above discussion 
applies (see e.g. [KAG, Ch.III] for many such constructions). Fundamental 
groups of normal ^''-covers, d > 3, of closed hyperbolic 3-manifolds, are ex- 
amples of convergence groups with critical exponent 2 (see [Re]). 

5. Isometric actions on trees 

I. Trees, spaces with walls, and cohomology. Although our main interest 
lies in actions on trees, we begin by indicating how our methods apply in a 
more general framework. The main result, as well as the approach taken in this 
subsection, is not original, but follows the work of Haglund, Paulin and Valette 
[HPV] . Since it is of considerable importance in what follows, for completeness 
we include a brief introductory discTission. 

The following notion was introduced by Haglund and Paulin [HP] as a 
tool in studying rich automorphism groups of certain CAT(O) spaces. It also 
unifies virtually all the known constructions of negative definite functions on 
groups, which arise from geometric actions. 

5.1 Definition [HP]. Let X be a (countable) set. A wall is a partition of 
X into two disjoint subsets, called half spaces. Let be a set of walls of X. 

Then the pair {X, W) is called a space with walls, if for all x,y E X, the set 
W{x,y) of walls separating x and y is finite. 

Given a space with walls (X,W), let H be the set of half spaces deter- 
mined by W. For x,y & X let E^, Ey C H he the set of half spaces containing 
x,y, resp. Then, by our assumption, the function on H defined by Ie^, — IEj, 
has finite support. In particular, it is in P{H), the space of square integrable 
functions on the (discrete) set H. Next, any action of a group T by automor- 
phisms on {X, W) induces an action on H, and thus a unitary representation 
on £'^{H). Choosing some fixed base point xq € X, it is easy to verify that the 
function b:T ^ i'^{H) defined by: 

(2) Hl) = '^E-,x,-lEx,€iHH) 

belongs to Z\r,f{H)). Since b G B\r,e^{H)) if and only if b is bounded 
(Lemma 3.3), we find that if for some point xq e X the function 

(3) 7 ^ Ue^x, - IexX = '^#W{jxo,xo) 

is unbounded on F, then H^{T,l'^{H)) ^ 0. The latter condition is satisfied in 
most natural examples of such actions, which we illustrate with the simplest 
one, namely, an action on a tree. 

Suppose that X = T is a (simplicial) tree. Denote by V (resp. E) the set 
of vertices (resp. edges). Then "cutting in the middle" an edge e E E defines 
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in an obvious way a partition of V into two half spaces, and the resulting 
space H of half spaces may be identified with the set E of oriented edges. It 
is clear from (3), that (2) defines an unbounded cocycle, unless the orbit Txq 
is bounded, in which case, as is well-known, a subgroTip of index 2 in F must 
fix some V £V. Summarizing our discussion, wc have the following: 

5.2 Proposition [HPV]. Suppose that a group T acts isometrically on 
a tree T = T{V,E). Let E denote the set of oriented edges. Then either T 
fixes some vertex or edge, or the natural unitary V-representation on £'^{E) has 
nonvanishing first cohomology. 

Before discussing Theorem 1.6, we mention that an analysis similar to the 
one below for trees can be performed with other known examples of spaces 
with walls. These walls have typically a natural geometric interpretation in 
terms of the structure of the space, as in the case of trees. Amongst the known 
constructions we mention Coxeter complexes [BJS], CAT(O) cubical complexes 
[NR], constructions in [BaSa] and [Bou2], and various examples of CAT(-l) 
spaces in [HP] (admitting a discrete co-compact action, and a simple, locally 
compact, nonlinear, nondiscretc group of automorphisms). Consequently, as 
we presently illustrate in the case of trees, unbounded isometric actions of lat- 
tices in SO(n, 1) and SU(n, 1) on these spaces, must admit "co-dimension one" 
subgroups (measured by the critical exponent), which stabilize walls (them- 
selves identified with co-dimension one geodesic hyper-planes). 

II. Proof of Theorem 1.6. We start by proving the first assertion on the 
weak inequality. This result will then be used in the more refined analysis 
needed for the strict inequality, which will occupy most of our attention. Notice 
first that if G = S0(2, 1) then d{T) = 1 and there is nothing to prove. In case 
G = S0(3, 1) = SL2(C) our method of proof fails (at least for nonuniform 
lattices; this is due to the failure of Theorem 3.6 in that case), but Z. Sela has 
informed us that then the theorem is known, based on 3-manifolds techniques 
(which do not seem to generalize). Thus, we assume henceforth that 6{G) > 2. 

Suppose that there is no fixed vertex for the F-action, and consider the 
unitary P-representation on i'^{E), as in Proposition 5.2. Since £^ is a discrete 
set on which P acts, we have: 

e'^{E) ^ e^^(P/re) 

where the sum is taken over the orbits, and Pe denotes a stabilizer of an 
(oriented) edge in the orbit. Notice that a stabilizer of an oriented edge has 
index at most 2 in the edge stabilizer; hence for the discussion of critical 
exponents we may fail to distinguish between them. Since we assume that P 
does not fix a vertex, and the result is trivial if it fixes an edge, we deduce 
from Proposition 5.2 that H^{r,£'^{E)) ^ 0. Therefore, induction from P to G 
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(and application of Theorem 1.10 when F is nonuniform) yields: 
H\G,lnd^f{E)) = H\G,®L'^{G/re)) ^ 0. 

We distinguish now between two cases: if the above G-representation con- 
tains weakly the trivial representation, this means that spherical complemen- 
tary series G-representations from any neighborhood of the trivial representa- 
tion must occur there weakly, and from the discussion in the proof of Theorem 
2.10 it follows that there is a sequence of edges with (5(re.) — > S{r), thereby 
proving even more than we claim. Otherwise, it follows that for some Tg one 
has {G , L'^ {G /T e)) ^ (see the discussion at the second part of the proof 
of step (iv) in Theorem 4.2). Prom Theorem 4.2 it then follows that L'^{G/Ve) 
can be strongly only for p > p{G) = S{G) = 5{T), which by Theorem 2.10, 
implies that S{Te) > 5{T) — 1, as required. 

The first part of Theorem 1.6 is now established. We continue our discus- 
sion through a series of results, aiming at the second part, and assume that 
Gt^ SO(2,l),SO(3,l). 

5.3 Proposition. Let (M, m) be a Borel a-finite measure space on which 
G acts measurably, preserving the measure m. Assume that the natural 

G -representation on L'^{M) is strongly U' for som,e 2 < p < oo, and that it 
admits an irreducible subrepresentation a which is strongly for the same p, 
but not strongly L'^ for any q < p. Then the unique spherical complementary 
series representation tt\ which is exactly" strongly LP, namely, the represen- 
tation TTx with p{p — A) = 2/9, also embeds as a subrepresentation of L'^{M). 

See Section 2. Ill for the notation and discussion of complementary series 
representations, and the relation between A and p. The relevance of Proposition 
5.3 to our discussion comes via the following: 

5.4 Corollary. Let G be as above and C < G be a discrete, torsion-free 
subgroup, which satisfies both 5{C) = 5{G) — 1, and {G , L'^ {G / C)) ^ 0. 
Let Ao denote the bottom of the L^- spectrum of the Laplacian A on the locally 
symmetric space C\G/K. Then Aq appears discretely in the spectrum of A; 
that is, there exists a nonzero L^-eigenf unction of A with eigenvalue Aq. 

Proof of 5.4 based on 5.3. We use freely the discussion in Sections 2. Ill 
and 2.V, regarding the connections between the critical exponent, the class one 
spectrum with the associated values for L^'-integrability, and the bottom of the 
L^-spectrum of A, acting in the corresponding locally symmetric space. Since 
6{C) = 6{T) — 1, the representation L'^{G/C) is strongly LP ioi p = 5{G). On 
the other hand, as H^{G,L^{G/C)) ^ 0, and G has only finitely many irre- 
ducible representations with nonvanishing first cohomology, we deduce, using 
the fact that L^(G/C) does not admit almost invariant vectors, that one of 
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these irreducible representations must appear discretely in L?'{G/C); see the 
second part of the proof of step (iv) in Theorem 4.2. However, in step (ii) of 
the proof of 4.2 wc saw that these irreducible representations are strongly L^^^^ 
as well, and that p = 6{G) is the minimal value for which they arc strongly 
L^. Therefore from Proposition 5.3 it follows that the complementary scries 
representation ttaq, with \q = p — (3, appears discretely in L'^{G/C). By the 
connection between the class one spectrum for the G-representation, and the 
Laplacian spectrum for the corresponding locally symmetric space. Corollary 
5.4 follows. □ 

Let us postpone further the proof of Proposition 5.3, and continue dis- 
cussing the proof of Theorem 1.6. Recall the following purely group theoretic 
notion: For a subgroup C < G, the commensurator of C in G is the subgroup 
CommcG = {g e G \ gGg^^ PI C has finite index in both C and gCg~^}. 
Notice that even if C is discrete, Comm^G need not be a closed subgroup. We 
shall need the following general observation: 

5.5 Lemma. Let G be a rank one simple Lie group with finite center, 
and C < G a torsion free discrete subgroup, for which the bottom Aq of the 
L'^-spectrum of the Laplacian on the locally symmetric space C\G/K is attained 
by a nonzero L'^-eigenf unction f. Then G has finite co- volume in the closure 
of CommcG in G. In particular, if T < G is a discrete subgroup containing 
G, then G has finite index in Commcr. 

Proof. It is a general fact about complete Riemannian manifolds, that if 
the bottom Aq of the spectrum of A occurs discretely, then up to a scalar mul- 
tiple it admits a unique (L^-)eigenfunction, which is in addition continuous and 
positive everywhere (up to a choice of sign); cf. [Su2, Theorem 2.8]. Consider 
the function f on G/K which lifts / from G\G/K, and fix 51 € CommcG. Since 
/ is G-invariant, the function gf{x) = f{g~^x) is g'G5f~^-invariant, and in par- 
ticular it is Go-invariant, where Go = gGg"^ fl G. By the finite index property 
of Go, the projection to Cq\G/K of both / and gf , is an L^-cigcnfunction of A 
with eigenvalue Aq (which is still the bottom of the spectrum). By the unique- 
ness property it follows that the projections of the two functions have constant 
ratio, denoted xid)-, where Comm^G — > M* is a multiplicative character. 
For every g G Ker x we then have gf = f, and as the elements in G which 
fix / form a closed subgroup, / is fixed hy H = Ker x (of course, G < H). 
However, recalling that the projection of / to G\G/K is square-integrable, we 
see easily that the i7-invariance of / is possible only if G has finite co-volume 
in H. 

Thus, it remains only to show that % = 1. Indeed, every g G Comm^G 
normalizes H (which, admitting the lattice G, is a unimodular subgroup), 
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hence its left action on H\G is well-defined, and preserves the G-invariant 
measure on the latter. On the other hand, since C is a lattice in H, and 

/ G L'^{C\G/K), the ff-invariance of / and the compactness of K show that 
/ lifts (and then descends) to an L^-function F on H\G. Integrating over H\G, 
wc get for all g € Commie the equality xid)'^ J F'^{x) dx = J F'^{gx) dx = 
J F^(x) dx; hence xio) = 1) required. □ 

We are now able to complete the proof of the second part of Theorem 
1.6 (modulo Proposition 5.3). Replacing T by a finite index subgroup, we may 
assume that it is torsion free. Recall that the proof of the first part of Theorem 
1.6 (i.e., the weak inequality), showed that it is enough to study an (oriented) 
edge stabilizer G < T such that H^{G, L'^{G/G)) 7^ 0, a fact which implies 
5{C) > 6{r) — 1. We further need to rule out a possibility of equality in either 
one of the two cases in the second part of the theorem. Notice that without 
any additional assumption, by Corollary 5.4 it follows that if equality holds, 
then the bottom of the Laplacian spectrum on C\G/K is attained. 

Consider the case of an isometric action on a locally finite tree T. It is easy 
to see that stabilizers of any two adjacent edges are commensurable, and hence, 
by connectivity, all edge stabilizers are commensurable one to the other, and 
the group N < T they generate, commcnsurates each one of them. It follows 
from the above discussion and the last statement of 5.5, that G has finite index 
in A^. Since N is normal in F, G must be commensurated by F. Again by 5.5 
it follows that G has finite index in T, which is of course impossible under our 
assumption S{G) = S{r) — 1. This completes the proof in the case of actions 
on locally finite trees. 

To establish the strict inequality for lattice T < SU(n, 1) (n > 2), we call 
on a result of Gromov and Schoen [GS, §9], asserting that any action of F on 
a tree, factors on some nonempty invariant subtree, through a discrete homo- 
morphism to PSL2(M). (That result assumes nonelementarity of the action, 
which is an interesting case for us as well, since otherwise it is easy to see 
that there are edge stabilizers with critical exponents tending to (5(r).) Since 
the image of such a homomorphism has positive first ^^-Betti number (e.g., 
by Theorem 1.5), the asserted strict inequality follows from the next general 
result, which may be of independent interest (and also sharpens Theorem 1.4): 

5.6 Theorem. Let F < G be a lattice, with G not locally isomorphic to 
SO(fc, 1), A; = 2, 3. Let N < T be the kernel of an epimorphism ofT onto a 
group with positive first £^-Betti number. Then S{N) > 6{r) — 1. 

Proof. By [BV] (see Theorem 4.3) the regular representation of the group 
T/N has nonvanishing first cohomology. Lifting the representation and the 1- 
cocycle to F, and then inducing to G, yield H^{G, L'^{G/N)) ^ (by Theorem 
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1.10 and the isomorphism Ind^f{r/N) ^ L^{G/N)). The fore Koing discussion 
and the proof of the first part of Theorem 1.6 show first that this impUes 

S{N) > d(T) — 1, and secondly, if cquahty holds, then [CommAr(r) : A^] < cx3 
(by Corollary 5.4 and Lemma 5.5). However is normal in F, so it must have 
finite index, which again contradicts the possibility S{N) = S(T) — 1. □ 

Finally, we turn to the proof of Proposition 5.3, which will then complete 
the proof of Theorem 1.6, and with it our whole discussion of actions on trees. 

Proof of Proposition 5.3. We shall assume, only to avoid introducing fur- 
ther notation, that p = S{G) (which is the value needed in the proof of Theorem 
1.6). The proof of Proposition 5.3 for a general value of p with 2 < p < cx3 is 
identical. 

We shall need to return to the discussion and notation in the proof of 
Proposition 2.5, taking G to be one of the simple Lie groups of interest to us, 
and K < G a maximal compact subgroup. Let u = vhea i^T-finite vector in the 
assumed irreducible subrepresentation a C L?{M) = r, and let ip = ijj denote 
the i^-invariant nonncgative function defined in the proof of Proposition 2.5 
via u. It is obvious by the definition of if, that we have for every g £ G, 
\{a{g)u,u)\ < {T{g)(p,ip). While in Proposition 2.5 we have used this kind of 
inequality to obtain an upper bound on the left side in term of the right one, 
here we shall use it to get a lower bound on the right side in terms of the left 
one. More precisely, as discussed in the proof of step (ii) of Theorem 4.2, the 
Langlands classification and the fact that a is assumed to be strongly for 
p = 5{G) > 2 (but not strongly L"? for q < 6{G)), imply that we may have 
chosen the X-finite vector u to satisfy 

(1) lim e^(i°s a) I u)\=G>0. 

a— +00, a€j4+ 

Therefore, in view of the relation between the matrix coefficients of u and (p, 

(1) implies 

(2) liminf e^(i°sa)^^(a)<^^<^) ^0. 

a— »oo, aSA+ 

Note that while in (1) we have C < oo, we do not claim here (although it is 
true) that the lim inf in (2) is finite as well. 

Now, the i^T-invariancc of f yields, by a standard direct integral computa- 
tion, that for every g (z G one has: {T{g)ip, ip) = j 'p\{g) dfi{X), where ipx is the 
spherical function of the class one representation nxp, with A € [0, ^d{G)] UiM, 
and the positive Borel measure /x has total mass < oo (see §2.111 for the 
notation). Notice that by our assumption that L?{M) is strongly L^^^\ Theo- 
rem 2.1, and the computations in Section 2.1 of L^-integrability of complemen- 
tary series representations, it follows that fi is supported on [0, ^S{G) — 1] UiM. 
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The assertion of Proposition 5.3 would follow by showing that n has an atom 
at ^S{G) — 1, as the complementary series representation at that value of A is 

precisely the one claimed to embed in L^(Af). Our strategy is to assume that 
IJ,{{^S{G) — 1}) =0, and derive a contradiction to the nonvanishing in (2), us- 
ing the faster decay of the other ^px^s, and Lebesgue's dominated convergence 
theorem. 

Indeed, recall that for t G M we have \(pit\ < (fo (cf. Theorem 2.2), and 

for < Ai < A2 < ^5{G), we have < ipx-^ < ipx^ < 1 (this well-known fact 
follows, e.g., from the integral representation of the spherical functions; cf. 
[GV, p. 104 (3.1.15)]). Recall also that when A is positive, there exists a finite 
limit: 

(3) lim e(''-^)(i°sa)^^(a) 

a— >c», a€j4+ 

(this well-known fact is actually covered by the discussion in step (ii) of The- 
orem 4.2; see also [GV, p. 172, Th. 4.7.4 (a)]). In particular, it follows from 

(3) for A = {^6{G) — l)/3 = p — (3 and the monotonicity of the <p;s^'s over the 
positive A's, that for some L < 00, all the (^a's with ReA < \5{G) — 1 sat- 
isfy for a € the uniform bound e^*-'°s"^|(/9A(fl)| ^ L. Therefore, Lebesgue's 
convergence theorem may be applied to show that when a ^ 00 in , one 
has: 

(4) j e^('°s«)<^A(a)dMA)^0, 

once we show that for ji almost every A, the expression in the integrand 
tends to zero. This, however, follows from (3) and our assumption that 
IJ.{{\5{G) - 1}) = 0, when A G (0, \5{G) - 1], and from the bound on a G A+ , 

bA(a)| < Ma) = S(a) < C(l + /3(loga)) ■ e-^5(G)/3a°g«) 

for all A G iM (see (9) in §2.111). As the expressions for which the limits in (4) 
and (2) are taken, identify, this establishes the required contradiction. □ 

6. Principal bundles, induction, and cohomology 

This section is devoted to additional preliminaries toward the proofs of 
the remaining results, in Section 7. The reader may prefer to skip to that 
section on first reading, after looking at Definition 6.1 below, which describes 
the setting in which we shall work in the sequel. 

I. Principal bundles and induction of unitary representations. The frame- 
work of principal bundles will be convenient, and we now define the exact 
notion to be used. 
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6.1 Definition. Suppose that M is a locally compact space, equipped with 
a (T-finite Borel measure on which a discrete group A acts properly discontin- 
uously, preserving /i. Denote the A- action from the right, and let M = M/A 
be the quotient space. We refer to this structure as a covering (principal) 
A-bundle M M. We say that it has a compact/finite measure base, if M 
has this property. If M has no topology, and the A-action is measurably proper 
with a fundamental domain M = M/A, we call M — M a measurable covering 
A-bundle. If a locally compact group G acts continuously (measurably) on M 
and M, preserving /i, so that its action on M commutes with that of A (and 
hence may safely be denoted from the left), we say that G acts by (measurable) 
covering A-bundle automorphisms. 

Choosing a measurable section ip for a measurable covering A-bundle, 
namely, a fundamental domain (p{M) = X C M for the A-action, yields a 
cocycle a for any action of a group G by measurable covering A-bundle auto- 
morphisms. More precisely, a : G x M ^ A is defined by: 

(1) a{g,m) = X if and only if gip{m)X € X. 

The outstanding example is of course that of a discrete subgroup A of a 
locally compact group G, where M = G and M = G/A. Our notation then 
reduces to that in Section 3.III (compare (3) there with (1) above). Exactly as 
in Section 3.III, one may then induce a unitary representation tt from A to G, 
keeping the same notation Ind^vr (or sometimes just Indvr, where the context 
is clear). The representation space is L^(M, 7^), and the G-action is given 
as in (4) there. Although a priori this construction depends on the choice 
of X, it is easily verified that a different section (i.e., fundamental domain) 
yields a cohomologous cocycle, and hence an isomorphic representation. Some 
basic properties that we shall need, following standard properties of Mackey's 
unitary induction operation, are given in the following: 

6.2 Lemma. Suppose that G acts measurably on a measurable covering 
A-bundle M —>■ M with finite measure base. Then for any unitary A-repre- 
sentations, tt, a, with Ind standing for Ind^, one has: 

(i) Ind(7r © a) = IndTT © Indo". 

(ii) // IT is a mixing A- representation, and the natural G- representation on 
L'^{M) is mixing as well, then so is the G-representation Indyr {recall 
that a unitary representation is called mixing if all the associated matrix 
coefficients vanish at infinity). 

(iii) If IT is weakly contained in a then IndTT is weakly contained in Indcr. 

(iv) Ind^^(A) = L'^{M,jjL), where the latter is the natural G-representation 
coming from its measure- preserving action on M, and ^^(A) is the left 
regular A-representation. 
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Proof, (i) is trivial. To prove (ii), recall that it is enough to exhibit a dense 
subspace of IndTr for which all diagonal matrix coefficients vanish at infinity. 
The subspace considered is that of the functions taking finitely many values 
(in Htt). Let / € L^(M, TYtt) be such a function, {vi} the finite set of vectors 
in its image, and C < oo a bound on the norms of all the Wj's. Fix some e > 0. 
Let F C A be the set of A's for which \{7T{\)vi,Vj)\ > e for some By the 
assumption on tt, F is finite. Let X C M and a: G x M ^ A be as in (1) 
above. Denote Y = XF"^ = UXA"\ A G F. Notice that y C M has finite 
measure. Now, given any g G, dividing X into the subsets where a{g~^,x) 
belongs, or does not belong, to F, we can estimate: 

\{9fJ)\ = I / {7^{a{g-\x))f{g-^x),f{x))d^i{x)\ < efi{X) + fi{X n gY) . 

X 

However, applying the assumption that L'^{M) is mixing to the charac- 
teristic functions of X and Y , yields that ji{X n gY) — >■ when g — > oo. Since 
e was arbitrary, we are done. 

Claim (iii) is again standard; see the proof of [Zil, 7.3.7]. Assertion (iv) 
and its proof are analogous to the well-known statement Ind^^^ (A) = (G) in 
the group theoretic setting. For the proof we distinguish between the G-action 
on M and M , by writing for the former g ■ m. Notice that by the definition 

(1) of a, and the section ip, we have: 

(2) ip{g ■ m) = g(p{m)a{g, m). 

The space L^(M,^^(A)) may naturally be identified with L^(M x A) 
with the product measure, by assigning /(m)(A) f{m,X). (Note that 
/ |/(m, A)|2 = / / l/(m)(A)p = / ||/(m)||2 .) The G-action on the for- 

MxA MA M 

mer space takes the form: 

[9f{m)]{\) = [a{g-\m)f{g-^-m)]{X) = [f {g'^ ■ m)]{a{g-\ m)-' X) , 
and thus its action on the latter is: 

(3) gf{m, A) = fig'^ ■ m, a{g~^ , m)~^ X) . 

Next, Mx A may naturally be identified with ATx A by (m. A) — > {ip{m), A). 
This identifies also the spaces L^{M x A) and L'^[X x A), and (3) now has the 
form: 

gf{x,X) = f{ip{g-' ■ ip-\x)),aig-\^-\x))-'X) 

= f{g-'xa{g-\ip-\x)),a{g'\^'Hx))-'\) 
(the last equality follows by substituting g = g~^ and m = ip~^{x) in (2)). 
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It is now clear that the map (x, A) — > xX from X x A to M is a measure- 
preserving isomorphism, which takes the latter G-action to the natural 
G-action on L^{M): gf{m) = f{g~^m), as required. □ 

II. A "transference" theorem. The following technical result will be essen- 
tial in the proofs of Theorems 1.2, 1.4 and 1.7. 

6.3 Theorem. Let M ^ M be a measurable covering A-bundle with fi- 
nite measure base, acted upon by G = SO(n, 1) or SU(n, 1), by bundle auto- 
morphisms. Assume that the G- representation on L'^{M) is strongly for 
some 2 < p < oo. Suppose that the group A is torsion free, and is discretely 
embedded in H = SO(m, 1) or SU(m, 1) for some m G N. Identify A with 
its image in H. Let ir be a unitary H -representation which is strongly for 
some 2 < g < oo {as an H -representation). Then Ind^7r|A is strongly L^ for 
r = max{|^-f 

Proof. The structure of the proof is as follows: In the first part we show 
how to convert the information given by the assumption into an L^-integrability 
property of the associated cocycle a; see (8) below. It is only in the second 
part that the representation tt is considered, where we show how to deduce the 
required estimate from (8). 

Let p = p{H) be the half sum of the positive roots of H, namely, 2p = 
6{H)P (we retain the notation of Sections 2 and 3, and in particular that for 
the complementary series representations tta, discussed in 2.II). Recall that for 
A = \X\(3 G a*, < |A| < IpI = ^S{H), the representation ttx is strongly L* for 
t = 2S{H)/{5{H) - 2|A|) (see (*) in 2.111). By Corollary 2.9, ttaIa is strongly 
L* for t = 26{A)/{5{H) - 2|A|). Assume for the moment that (5(A) > 0. Let Aq 
be defined by the equality t = 2, or more precisely: 

(5) 2<5(A)/(<5(i7)-2|Ao|) = 2, equivalent^, |Ao| = ^(<5(il) - (5(A)). 

If (5(A) = replace (5(A) by any positive value strictly less than 2, say, by 1. 
Notice that in both cases Xq < p and ttxq is nontrivial. Therefore, by the choice 
of Aq, ttaoIa is strongly (when (5(A) = we get that it is strongly L^, hence 
also L^). By [CHH] it is weakly contained in ^^(A). From Lemma 6.2 (iii), 
(iv), and the assumption, it now follows that Ind^TTAoU is weakly contained in 
a strongly L^ representation, hence by Theorem 2.1 (4), it is itself strongly L^. 

We claim that by the torsion freeness assumption, one can always find a 
-fC-equivariant section (K < G maximal compact) (p : M ^ M for the natural 
projection, or equivalently, a fundamental domain X C M for the (right) 
A-action, which is (left) K-invariant. Let us postpone the proof of this fact to 
the end of the proof (see 6.4 below), and assume for the moment that X C M 
has this property. Let a : G x M — > A be the cocycle as in (1), corresponding 
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to this X. Let vq be the (unique up to scalar) iC-invariant unit vector in 
ttxq, and consider the constant function / : X — > Ti-T^x^'- /(^) = "^Oj in the 
representation space L^(X, T^TrAg) of Ind^TTAolA- Then / is i^C-invariant for the 

G-action (this follows only from iiT-invariance of X), so by Theorem 2.1 and 
the fact (established above) that this representation is strongly LP, we get for 
every e > 0: 

(6) j\j {gf,f)dx\P+'dg = J\J {nxoaig-\x)vo,vo)dx\P+'dg < oo. 
G X G X 

However, recall from (11) in Section 2 (and the remark thereafter), that for 
some constant C > : 

(7) < C ■ e(^o-P)i°g«("(9"''^)) < {TrxM9''\x>o,vo)- 
Thus, substituting (7) in (6) we deduce that for all £ > 0: 

( J e(^o-^)^°s"("(»"''^))da;)?'+''d5 < oo 
G X 

or equivalently, by (5): 

(8) J {J e-^'5(^)/^i°g«("(fl"'.^))dx)^'+^d5 < oo. 
G X 

Moving on to the second part of the proof, let tt be some unitary 
i?-representation which is strongly L*. If q6{A)/5{H) < 2 then from Corollary 
2.9, 7r|;^ is strongly L^. By the argument above, Ind^vrjA is strongly L^, so we 
have nothing to prove. Otherwise we have r = ■ ^ > p. Let Tio C 7i 
be the (dense) subspace of K-finite vectors. Then, as in the proof of 4.10, the 
subspace of functions f : X ^ Hq which take finitely many values is dense, 
and it suffices to prove that the matrix coefficient associated with any two such 
functions is in U'~^'^{G), for all e > (where r is as in the theorem). 

Let then cp,ip : X ^ Hq be two such functions, and F = {ui} C Hq be 
the finite set of (K-finite) vectors in their image. Then, for every ^ > we can 
find, by Theorem 2.1, a constant Co < oo, such that for every h e H: 

(9) 5:i(.(/.)..,.,)|<C,.e(-^+^)^'°-('^). 

Fix some "small" 9 for the moment. Choose any ro > r, and take po > p 
such that t = ^ > -. As we assume now that r > p, we have t > 1. By 
Holder inequality and the assumption that X has finite total measure (which 
may assumed to be one), we have for every positive function f : X ^ R, the 



RIGIDITY AND UNITARY REPRESENTATIONS 



165 



inequality (J fdxy^'° < (J f*dxy°. Applying this and (9) yields (arguing as in 
the proof of Lemma 4.10): 

J \{gip,i^)rdg< J{Jcge^-'-^+'^^'°^<''^'"''^Uxrdg 
G G X 

a X 

In light of (8), the last integral converges once —t-^^ +t9 < — ^5(A), or 

Q < — The right-hand side in the latter inequality would be zero for 

t = r/p, by definition of (and our current assumption on) r. Since t > r/p, the 
integral would indeed converge had 9 > been taken small enough (according 
to the choice of ro and po, which has to be made first). Since tq > r is arbitrary, 
the theorem follows. We have only to complete the following unfinished point 
in the proof: 

6.4 Lemma. With the notation of Theorem 6.3, one can always find a 
measurable K-equivariant section ip : M ^ M. 

The result is standard, but we failed to find a reference. For completeness 
we sketch the proof (note that the torsion freeness assumption is necessary). 

Proof. Let il) : M ^ M he a, section and a : K x M — > M the associate co- 
cycle. Consider the induced representation Ind^£^ (A) , which as in the proof of 
(iv) in Lemma 6.2, is isomorphic to the if-representation on L^{M x A), where 
K acts on M X A by k{m, A) = {km, a{k, m)~^\). Since K is compact, such a 
representation must have a nonzero invariant vector. Suppose for the moment 
that K acts ergodically on M. Then, as stabilizers of nonzero vectors in ^^(A) 
(for the A-regular representation) must be trivial (by torsion freeness), we get 
from Zimmer's cocycle reduction lemma [Zil, 5.2.11], that a is cohomologous 
to a cocycle taking values in e € A. Equivalently, for some / : M ^ A we 
have f{m)~^a{k,m)f{km) = e for all k ^ K and (almost all) m. The section 
99(777.) = ip{m)f{m) then satisfies ip{km) = kip{m) as required. In general, of 
course, the K-action on M is not ergodic, but one can use the above argument 
for each ergodic component (which is just an orbit). The proof of Lemma 6.4, 
and hence that of Theorem 6.3, is now complete. □ 

III. The bundle- induction operation on the first cohomology. Our goal here 
is to show that under suitable conditions, one has an injection of H^{A, vr) into 
i?^(G, Ind^vr). As in Section 3.III, we first need to know that an appropriate 
map between the cohomology groups exists, and then study its properties. The 
question of existence of the map is completely analogous to that in Section 3.III. 
The notation and arguments used there apply here verbatim, and in particular 
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condition (10) there ensures that the map b ^ b defined in (5) yields a weU- 
defined Unear map summarize these facts, we 

have: 

6.5 Proposition. Let M ^ M be a measurable covering A-bundle, acted 
upon by G by bundle automorphisms. If there exists a fundamental domain X 

for which the corresponding cocycle a : G x X ^ K satisfies condition (10) 
in Section 3, then the map b ^ b from H^(A,it) to H^{G, Ind^n) in (5) is 
well-defined. In particular, this is the case if a(g, •) takes finitely many values 
for every g G G, and X [equivalently M) has finite measure. Consequently, if 
M M is a {continuous) covering A-bundle with compact base, this condition 
is satisfied. 

Once the map between the first cohomology groups is well-defined, we 
may inquire as to when it is injectivc. This will not always be the case, and 
our next purpose is to describe a situation where it is. To this end we have 
the following: 

6.6 Lemma. Let G be a locally compact group, (vr, H) a unitary G-rep- 
resentation, and b € Z^{G,Tr) a cocycle. Then the following conditions are 
equivalent: 

(i) If g ^ CO in G then \\b{g)\\ co inH. 

(ii) The associated isometric G-action p onTi is proper [see Section 3.1). 

(iii) There is one vector v such that \\p{g)v\\ oo whenever g oo. 

When one {and hence all) of these conditions hold, we call the cocycle b 
proper. If G is not compact, and b is proper, then b is not a coboundary. 

The verification of the lemma is simple and wc omit it. The following 
result is a little more general than the one we shall actually need here, but it 
will also be used elsewhere. 

6.7 Lemma. Let M ^ M be a measurable A-bundle with a base of finite 
measure {denoted fi), on which a locally compact group G acts by bundle au- 
tomorphisms. Suppose that for the associated cocycle a : G x M ^ A, the 
following two conditions are satisfied: 

(i) a{g, ■) takes finitely many values in A, for any g G G. 

(ii) For every sequence gi ^ oo and A G A, /i{m G M\a{gi,m) = A} ^ 0. 

Then for every unitary A-representation tt, condition (10) in Section 3 is sat- 
isfied, and for every proper cocycle b G Z^(A, tt), the cocycle b G ^'■'^(G, Ind^Tr) 
is proper as well. 
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Furthermore, conditions (i) and (ii) are satisfied if M —>■ M is a covering 
A-bundle with compact base {Def. 6.1), where the cocycle a corresponds to a 
bounded section, and the natural G-representation on L'^{M) is mixing. 

Proof. For the first assertion see Proposition 6.5. To show the second, we 
switch to the framework of isometric actions and use condition (iii) in Lemma 
6.6. Denote by p the isometric action of A on which corresponds to b, and let 
V & H he any vector. Consider the constant function /(m) = v in L^(M, 7Y). 
By the assumption on b, we may find for every C < oo a finite set F C A, such 
that for every A outside F one has ||/9(A)v|| > C. Given a sequence gi — oo, 
by assumption (ii) we have for all i large enough 

H{m G M\a{gr\m) e F} < ^n{M), 

which gives 

J \\poa{g-\m)f{gr^m)fd^i{m) > ■ ^fi{M). 

M 

Finally, in the assumed topological covering bundle situation, it is clear 
that condition (i) is satisfied. To establish (ii) denote by X C M the image of 
a bounded section of the bundle, and fix A G A. Then the mixing assumption 
implies that /x(X fl gi{XX''^)) — > 0, which is exactly the condition asserted 
in (ii). □ 

7. Proofs of Theorems 1.2, 1.4 and 1.7 

I. Proof of Theorem 1.4. Retain the notation in the statement of the the- 
orem. Denote N = Kertp, A = Im(p, A = T/N. Since A is linear, by passing to 
a subgroup of finite index in A (and then in F) , we may and shall assume that it 
is torsion free. Consider the natural projection (covering) map M = G/N — > 
M = G/T, which is naturally a A-bundle (Definition 6.1), using the (well- 
defined) A-action on G/N from the right. Of course, G acts from the left by 
A-bundle automorphisms. Suppose now that vr is some unitary A-represent- 
ation. Then there are two ways to induce vr to a G-representation. The first is 
as in the procedure described in Section 6.1, with G acting by A-bundle auto- 
morphisms. The second is by consideration of tt as a F-representation factoring 
through its projection to A, and then by induction as in Section 3.III, accord- 
ing to the usual Mackey's construction. It is an easy exercise, which we leave 
for the reader to verify, that these two ways yield (naturally) isomorphic repre- 
sentations. We shall need in the sequel both constructions: the first to control 
L*'-integrability of the induced representation (making use of Theorem 6.3), 
and the second to deduce that the first cohomology injects, if F is nonuniform 
as well, applying Theorem 1.10. 
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First, notice that the statement of the theorem is trivial if G = S0(3, 1), 
for the first summand is at least ^S{r) and the second is at least 1. If S{T) < 2 
we clearly have the inequality asserted there. Thus, we may exclude that 
group, and deduce from the foregoing discussion and Theorem 1.10, that for 
any lattice T < G, uniform or not, we have for every unitary A-representation 
a, an isomorphism H^{A,a) = H^{G,lndfa). 

The case < 1, namely, 5(A) < 2, is dealt with by Theorem 5.6 
and Theorem 1.5, which in fact yield a strict inequality. We may therefore 
assume that 5(A) > 2. Let vr be an irreducible unitary /^-representation with 
H^{H,7r) / 0. By (the proof of ) Theorem 4.2, TT is strongly L'^ for q = 6(H). 
Recall that we have M = G/N. By Theorem 2.10 the G-representation on 
L2(M) ^ L'^{G/N) is strongly LP ior p = po = max{2, (5(G)/(5(G) - S{N)}. 
Thus, we may substitute this p = po, and the above value of q, in Theorem 
6.3. It follows that Ind^vrjA is strongly U' for r = max{|^ • ^,pq} = 6{A)^ 
(as we are assuming 6(A) > 2). On the other hand, by Theorem 3.4 we have 
H^(A,Tr\A) ^ 0, and hence, by the discussion at the beginning of the proof, 
ii"HG',Ind^7r|A) ^ 0. Theorem 4.2 now implies that Ind^vrjA is strongly 
only if r > 6(G) = 6(T). Comparing this with the above value of r, we see 
that we must have (5(A)^ > 6(T). Substituting for po we deduce: 

(1) 6(r) < ^ ma^{2, 6(r)/6(r) - 6(N)}. 

Now, if 6(r)/6(r) - 6(N) < 2 then (1) implies that 6(r) < 6(A), which is 
just what the theorem claims. Otherwise, we conclude: 

6(T) < h(A)6(T)/6(T) - 6(N) and hence 6(T) - 6(N) < ^6(A), 
which completes the proof of the theorem. □ 

Finally, let us discuss the observation made in the introduction, following 
Theorem 1.4. The starting point of this construction is the existence of homo- 
morphisms of certain lattices in SO(n, 1) (for all n > 2), onto nonabelian free 
groups; see e.g. [Lub2]. Suppose that ip : T ^ F is such a homomorphism, 
and denote by N its kernel. Notice the following general claim: If T/N is 
nonamenablc (which is the case for us), then 6(N) < 6(T) (the "only if" part 
holds as well, and is easier to establish). To show this claim observe that the 
conclusion is equivalent to the statement that the bottom of the Laplacian 
spectrum on Ar\EI" is positive, which is itself equivalent to saying that the 
G-representation on L^(G/iV) does not contain Iq weakly (see the discussion 
in Section 2.V above). However by the assumption, l^iV /N) does not contain 
Ir weakly, and we also have hid^l'^(T/N) ^ L'^(G/N). The claim now follows 
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from [Mar2, III. 1.11 (b)] and the well-known fact that Lq{G/T) does not con- 
tain 1(5 weakly. Now, returning to the observation, denote a = 5{N) < S{T). 
Then, given any e > 0, one can embed the free group F inside T, with a 
critical exponent less than e (Lemma 2.7 (3)). Taking the composition as a 
homomorphism of T into itself establishes now the observation. □ 

II. Proof of Theorem, 1.2. We consider first the case G = SO(n, 1) n > 3, 
and then discuss the modifications required for SU(n, 1). 

Assume G = SO(n, 1), n > 3. Recall that the universal cover of G, 
G = Spin(n, 1), is a two- fold covering, and hence has a finite center. We 
may thus replace G by G and assume that G is simply connected. Denote 
A = 7ri(-M). Then by standard covering theory we may realize A as acting 
discontinuously on M (from the right), commuting with the lifted G-action 
(from the left). In other words, M — > M is a covering A-bundle with compact 
base, on which G acts by bundle automorphisms (see Definition 6.1). 

The assumption of measurable properness of the action implies that the 
G-representation on L^(M) may be embedded in a multiple of the regular 
G-representation. Indeed, by Mackey's well-known orbit theorem, L^(M) = 
J L'^{G/Gx)dfi{x), where the integration is taken over the (measurable by our 
assumption) set of orbits, and Gx is a stabilizer of a point x in the section (the 
measure n is the one induced by M on this space). However, by our assumption, 
for almost every x the subgroup G^ is compact, hence Lp'{G/Gx) C L^{G). It 
follows that L'^(M) may be embedded in oo • L'^{G), and in particular it is 
strongly (and mixing). 

Let A be identified with its discrete image in some H = SO(m, 1) or 
SU(m, 1). Let tt be an irreducible unitary iJ-representation with H^{H, vr) ^ 0. 
By (the proof of) Theorem 4.2, tt is strongly L^^^^ (as an iJ-representation). 
We now wish to invoke Theorem 6.3 for the representation vr. With notation 
as in that theorem, we may take by the above discussion p = 2, and q = S{H). 
It then follows from Theorem 6.3 that the induced representation Ind^vr is 
strongly for r = max{(5(A), 2}. 

Let us assume first that n > 4; that is, G ^ S0(3, 1) = SL2(C). Then 
5{G) = n - 1 > 3. Thus, if (5(A) < 6{G) wc have r < 5{G). On the other hand, 
by Proposition 6.5 the map b from Z^{A,7r\\) to Z^(G, Ind^7r|A) is well- 
defined. Choosing b as the restriction to A of a non-coboundary iJ-cocycle, we 
have by Theorem 3.4 and Lemma 6.6, that b is proper. Hence, from Lemma 6.7 
it follows that i7^(G, Ind^7r|A) 7^ (by the last part of Lemma 6.7, conditions 
(i) and (ii) there are indeed satisfied in our case). However from Theorem 4.2 we 
now deduce that Ind^7r|A cannot be strongly L'^ for r < 5(G), a contradiction 
which proves the result. 

We are left with the case G = S0(3, 1). Here we have to show that 
(5(A) > 2. Otherwise it follows from Theorem 1.5 that H^{A,f{A)) ^ 0, and 
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that moreover, there is a proper A-cocycle for the regular A-representation 
(the latter follows from the proof of Theorem 1.5, going back to Theorem 
3.4). As before wc deduce that Ind^£^(A)) 7^ 0; hence by Lemma 6.2 

(iv) H^{G,L'^{M)) 7^ 0. However as we observed at the beginning of the 
proof, L'^{M) C 00 • L^{G). If the latter representation has nonvanishing 
first cohomology, then so does L'^{G); hence by Theorem 4.3 we would have 
p{G) = 0, contradicting Theorem 4.2. 

Remark. Notice that in the case of S0(3, 1) = SL2(C), the argument 
above, together with that used in the proof of Theorem 1.5, show that if 
equality 5(7ri(M)) = 2 holds, then 7ri(M) must be a divergence group. 

Let us discuss now the case G = SU(n, 1). In the higher rank results 
of Zimmer, an assumption of finite fundamental group is always made on G, 
which is a minor restriction in view of the relatively few examples of simple 
groups without this property (see [Zi2]). As we cannot afford to lose "half of 
our clients" , we discuss the issue of how these groups may be treated as well, 
which is not simple enough to be left untouched. 

To illustrate the necessity of a modification of Theorem 1.2 for these 
groups, consider the outstanding example M = G/T, which motivates the 

general theorem. Here M ^G = SU(n, 1), and tti{M) ^ f is just the "lift" of 
r to G, which is an infinite central extension of F. Having an infinite center, 
r admits no discrete embedding in a rank one simple Lie group with finite 
center. Consequently, our result regarding injective homomorphisms of 7ri(M) 
into such groups, although strictly speaking is valid, becomes of little interest. 
Analyzing the problem in the more general perspective of Theorem 1.2, ob- 
serve that lifting the G-action on M, to an action of G on M, one easily verifies 
by the construction of the lift that p~^{e), where p : G ^ G is the covering 
homomorphism, acts on M by deck transformations over M, and hence maps 
naturally into 7ri(M) (possibly with kernel). Since the G-action on M com- 
mutes with that of 7ri(M), the image of p~^{e) lies in the center of 7ri(M). As 
in the preceding discussion, of "real" interest to us are those homomorphisms 
of 7ri(M) which may have kernel contained in the image of p~^{e). We shall 
call such a homomorphism an isogeny, and prove Theorem 1.2 for this class 
of homomorphisms. In the exemplary case of M = G/T, 7ri(M) = F, we see 
that any embedding of F, when viewed as coming from F through the natural 
projection, defines an isogeny of 7ri(M), and will therefore be covered by our 
analysis. 

Yet, when G = SU(n, 1), the assumption that the lifted G action on 
M is proper (topologically or measurably) is too restrictive, as often the 
G-action lifts to an action of a finite cover of G, so the G-action will admit 
an infinite kernel. In addition, Gromov's theorem, which is so essential in our 
main application of Theorem 1.2, is not quite the same when G has an infinite 
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fundamental group. Rather than stating some technical general assumptions 
on the G-action, which resolve the above problems, and then verify them in 
our main application (Corollary 1.3), let us aim directly at this application, 
relying upon Gromov's theorem [Gr2]. The proof of the Corollary lends itself 
to the appropriate generalization, and we leave this matter to the reader. 

7.1 Theorem (Corollary 1.3 for SU(n, 1)). Suppose that the connected 
Lie group G has finite center, and is locally isomorphic to SU(n, 1) (n > 2). 
Assume that G acts on a compact manifold M, satisfying all the conditions in 
Corollary 1.3. Let if : 7ri(M) ^ A be an isogeny (see the above discussion) 
onto an infinite discrete subgroup A of H = SO(m, 1) or SU(m, 1), for some 
m G N. Then (5(A) > (5(G) = 2n. 

Proof. Consider the lifted G action on M. Denote by p : G — >■ G the 
covering map. The proof proceeds now in the following steps: 

1. We may assume each element inp^^{e) acts properly on M, hence the 
Z{G)-action is proper. Indeed, by standard covering theory, every z G p~^(e) 
acts as a deck transformation over M. Denoting by A/" C p~^{e) the kernel of 
the action, the G-action on M factors through an action of G/M (the latter 
still covers G, and we keep the notation p for the covering homomorphism) . 
Replacing Ghj G/H throughout the rest of the proof, we reduce to the situ- 
ation of 1. The last claim of 1 follows readily from the fact that G has finite 
center, so that p~^{e) has finite index in Z{G). 

2. The G action on M is {measurably) proper. Indeed, notice that Gro- 
mov's theorem in case 7ri(G) is infinite ([Gr2, 6.1.B]; see also Remark 6.1.C 
therein), asserts that the lifted action on M is proper modulo the center; that 
is, for almost every m M, for any sequence gi € G with Ad{gi) cx) in 
Ad(G), one has gim oo (we thank R. Zimmer for drawing our attention to 
this crucial fact). Suppose now that for such m G M, there exists a sequence 
gi G G, 3i — ^ oo, with gim bounded. Discarding a null set, by the above we 
must then have gi = Ziki, where Zi G Z{G), Zi oo, and the ki^s arc bounded. 
However then the points kim are all contained in some compact subset, and 
since by (1) the Z(G)-action is proper (moreover, a finite index subgroup acts 
effectively by deck transformations over M), this is impossible. 

3. Denote N = Ker (p. The assumption that ip is an isogeny means that 
N C p^^{e). By 1 every element of N acts properly on M, and we may consider 
the quotient M/N or N\M (both of which make sense and coincide, because 
N C 7ri(M)). We have a normal covering M/N — >• M, and the group of deck 
transformations of M/N over M is naturally isomorphic to A. The G-action on 
N\M factors through an action of Gi = G/N, which is (measurably) proper 
by 2. 
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4. The index of N in p~^{e) is finite. Consequently, Gi {defined in 3) 
has finite center. Indeed, if \p~^{e):N] = oo, it follows that A has infinite 
center. Since we assume that it is embedded discretely in a rank one simple 
Lie group with finite center, A must be amenable, hence 7ri(M) is amenable as 
well: 1 -< ^^(7ri(M)). Inducing the latter weak containment of representations 
to Gi, and applying Lemma 6.2 (iii), (iv), we get 1 C L^(M) ~< L'^{M). 
However, by step (3) above, G\ acts measurably properly on M; hence, as in 
the proof of Theorem 1.6, Mackey's orbit theorem implies that L^(M) embeds 
in a multiple of L^(Gi). But this and the previous conclusion imply together 
that 1 ^ oo • L^(Gi), contradicting the nonamenability of Gi. 

Conclusion of the argument. By 3 we see that M/N —>■ M is a covering A- 
bundle with compact base, on which Gi acts by bundle automorphisms, acting 
properly on M/N. Prom 4 it follows that Gi is commensurable with SU(n, 1), 
and in particular p{Gi) = p{G)(= 2n). At this point, exactly the same proof 
as in the case of SO(n, 1) applies. □ 

III. Proof of Theorem 1.7. Reversing sides for convenience, suppose by 
contradiction that M = A\G/T is compact. Dividing out the finite center, we 
may assume that G is (real) algebraic. Since the Zariski closure of L commutes 
with A and satisfies the same hypothesis as in the theorem, we may also assume 
that L is algebraic. In particular, by nonamenability of L, it contains a copy 
of (P)SL2(M), denoted henceforth by S. As L commutes with A, it acts on M 
by left multiplication. Denote M = G/T. Then both L and A act from the left 
on M, in a commuting way, so M ^ M is a covering A-bundle with compact 
base, on which L acts by bundle automorphisms (Def. 6.1). 

Assume now that A is embedded discretely in some SO(n, 1) or SU(n, 1). 
Let TT be a unitary representation of that Lie group which is strongly for 
some p < oo, and has nontrivial first cohomology (see the proof of Theorem 
4.2). Then by Theorem 3.4 and Corollary 2.9, restricting tt to A yields a 
strongly representation for some q < oo, which we continue to denote 
by TT, with a proper cocycle b G H^{A,7r) (Lemma 6.6). Consider the induced 
L-representation a = lnd;^7r. We claim that a\s is strongly L*" for some r < oo. 
Indeed, to invoke Theorem 6.3 for that purpose, we only need to explain why 
the /S-representation on L^(M) = L^(G/r) is strongly L* for some t < oo. 
For this, we use the (necessary) assumption that A is infinite, which implies 
that r is not a lattice in G (indeed, by Poincare recurrence, the A-action on 
G/T would not then be proper). Therefore L?'{G/T) does not admit a nonzero 
G-invariant vector. By a well-known result of Cowling [Co2], together with 
the fact that G must have real rank at least 2 (by the existence of a simple 
noncompact subgroup S which commutes with a noncompact subgroup A), 
we deduce that L'^{G/V) is strongly L* for some t < oo. The latter holds as 
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a G-representation, and hence also when restricted to any closed subgroup, 
particularly, to S (cf. [Ho, 6.4]). We have thus shown that a\s is strongly U 
for some r < oo, and since S = (P)SL2(M) is not amenable, we conclude that 
a\s does not contain weakly the trivial representation ([Sh3, Th. C]; sec also 
step (iv) in the proof of Theorem 4.2 above). In particular, this conclusion 
holds for a as an L-representation. 

Recall that the original A-representation tt came with an associated proper 
1-cocycle; hence by Lemma 6.7 we have H^{L,a) ^ 0. (By the last part of 
Lemma 6.7, conditions (i) and (ii) there are indeed satisfied in our case; see 
below for the second one.) We now call on a result in [Sh2], concerning the 
so-called first reduced cohomology group (see the discussion preceding The- 
orem 9; briefly, with the notation of Section 3.1 above, is the quotient of 
by the closure of in the topology of uniform convergence on compact 
subsets). On the one hand, an easy and well-known fact is that for repre- 
sentations without almost invariant vectors, the two cohomology groups 
and coincide (cf. [Sh2, 1.6]). On the other hand, it is shown in [Sh2, 3.6] 
that for any unitary representation o" of a locally compact group L, satisfying 
H^{L,a) 0, the center Z{V) admits a nonzero invariant vector. We deduce 
that the induced L-representation admits a nonzero vector, invariant under 
Z{L). 

Finally, we observe that the 2'(L)-action in a must be mixing, a contra- 
diction which will complete the proof of the theorem. Indeed, this follows 
from Lemma 6.2 (ii), whose two assumptions are verified using Howe-Moore's 
theorem [Zil, 2.2.20]; that theorem applies to the original A-representation 
TT, being a restriction of a representation of a simple Lie group without in- 
variant vectors, and to the representation on L^(M) = L^(G/r), using our 
previous observation that V cannot be a lattice in G. This completes the proof 
of Theorem 1.7. □ 



8. Further remarks and related questions 

8.1. The results of Section 4 suggest the following question: Suppose that 
TT is an irreducible unitary L-representation (L < G = SO(n, 1), SU(n, 1), a 
lattice), such that i?^(r, tt) ^ 0, and tt is strongly IP^^ (i.e., strongly L'^^^^). 
Is TT necessarily a restriction of a G-representation? In other words, is there 
only one such vr for F < SO(n, 1) and two for F < SU(n, 1)? Notice that 
by [CS] the above F-representations arc indeed irreducible (and in the case 
of SU(n, 1), the two are non isomorphic). Of course, one has to exclude here 
S0(2, 1) = PSL2(M). An affirmative answer to this question would be quite 
striking, and come close to a representation theoretic proof of Mostow's rigidity 
theorem. Indeed, \i ip : V\ ^ is an isomorphism between two lattices 
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of G, then the Fi -representation -k o ip, when vr is the restriction to r2 of an 
irreducible G-representation with ^ 0, is also a strongly LP cohomological 
representation, with 'minimal' p. Knowing that vr o extends to G yields 
interesting information on ip, and the missing piece to deduce that ip itself 
extends to G, is exactly the main result of [BiSt], proved for PSL2(M). This 
beautiful theorem in [BiSt] is trivial for other rank one lattices, once one uses 
Mostow's rigidity; however the fact that it holds for PSL2 (M) , in which rigidity 
is typically less seen, suggests that it might be proved independently, for other 
groups. 

8.2. In view of the simplest, geometric constructions, of amalgam split- 
tings V = A*c B ioY lattices F < SO(n, 1), where C is the fundamental group 
of a totally geodesic, co-dimension one separating hyperplane, one is naturally 
led to ask whether this must be the case whenever equality in Theorem 1.6 is 
satisfied, namely, when 5{G) = 5(r) — 1. Such a result would be analogous to 
Bourdon- Yue's superrigidity theorem mentioned after Theorem 1.1. The anal- 
ysis in §5.11 provides evidence to an affirmative answer, and especially to our 
(apparently weaker) conjecture that in case of equality, G must be a lattice in 
SO(n — 1,1). Recall that it was shown in §5.11 that in case of equality, the bot- 
tom of the Laplacian spectrum in G\G/K is attained, which yields significant 
geometric information (see [Su2] ) . The question of existence of nonelementary 
actions on trees, of lattices in SU(n, 1), seems open in general. 

8.3. Separate discussion of the different possibilities which can occur in 
inequality (1) of Theorem 1.4 leads to a more illuminating result, putting for- 
ward an intriguing question. Again, we shall not discuss the group SL2 (M) , and 
let us leave aside, for the moment, also the group SL2(C). Retain the notation 
in Theorem 1.4. By dividing out the finite center, we assume hereafter that G 
is center free. Consider now the case where p is not injective. Then N = Ker ip 
is a normal, nonamenable subgroup of F, which seems to imply in general that 
Ao, the bottom of the spectrum of A for N\G/K, is strictly smaller than its 
value ((5(G)^/4) for the symmetric space. This is the Riemannian analogue 
of Kesten's well-known theorem [Ke], asserting that for any generating, sym- 
metric probability measure on a finitely generated group F, the norm of the 
corresponding convolution operator in f^(T) is strictly smaller than its norm in 
£'^{T/N), for any normal nonamenable subgroup N (the normality assumption 
is crucial). We have failed to find reference for the result in the Riemannian 
context, however, at our request it was recently proved in the co-compact case 
by Vadim Kaimanovich [Ka], to whom we extend our gratitude. Of course, if 
the bottom of the spectrum of N\G/K is strictly smaller than (5(G)^/4, then 
5{N) > 6{G)/2 (see §2.V and the references therein). 
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Once this claim is established, one may break inequality (1) in Theorem 
1.4 into a more refined version. Indeed, with the notation of Theorem 1.4, and 
denoting ip{T) = Im ip, the following possibilities occur: 

(i) Either (p is injective, implying 6{r) < (5(Im if) (Theorem 1.1); or 

(ii) (5(Im (p) < 2, implying S{r) < 5(Ker (f) + 1 (Theorem 5.6); or 

(iii) ip is noninjective and S{lm (p) > 2, implying S{T) < (5(Ker ip) + ^S{lm tp) 
(Theorem 1.4). 

The superrigidity theorem of Bourdon- Yue (and its strengthening in 
[BCG]), mentioned in the introduction, yields a complete understanding of 
case (i) (for uniform lattices), and it seems that not much more can be said in 
case (ii), which already provides a strict inequality. Thus, if one could prove 
that in case (iii), strict inequality always holds as well (which we believe to 
be the case), this would show that equality in Theorem 1.4 occurs if and only 
if the homomorphism ip extends to the ambient group. Returning now to the 
case of SL2(C), wc sec that, curiously enough, this superrigidity-typc result 
indeed holds, at least for uniform lattices, simply because 6{r) = 2 (relying 
only on Kaimanovich's result mentioned above). Illustration of the wealth of 
situations which can occur for noninjective homomorphisms can be found in 
an example of Mostow [Mo, §22], where an arithmetic lattice T < SU(2, 1) 
is shown to map surjectively, with infinite kernel, onto a different arithmetic 
lattice of that group. 

8.4. Our proof of Theorem 2.1 made essential use of the full continu- 
ous strip of complementary series representations. While for the other rank 
one groups, results of Cowling regarding existence of appropriate uniformly 
bounded representations may serve as a substitute, for higher rank groups 
some new idea seems to be required. By Cowling's general "Kunze-Stein phe- 
nomenon" [Col] , for any simple Lie group and even p, once a representation is 
strongly LP, then all its matrix coefficients are in 1^+^ for all e > 0. However, 
even for SO(n, 1) and SU(n, 1), it is not known whether for any irreducible 
representation, all matrix coefficients lie in the same L^. We remark that by 
applying a general result of [KS] in addition to Theorem 2.1, it follows that 
for any irreducible representation tt of G = SO(n, 1), SU(?t., 1), if there is one 
matrix coefficient in U'~^^{G), then all matrix coefficients of the smooth vectors 
satisfy a decay estimate similar to (6), essentially replacing the Hilbert norm 
by a Sobolev type norm. Another related question, considered by Howe [Ho] 
(see the remarks preceding the proof of Corollary 7.3 there), is whether for ev- 
ery p, not only an even integer, the set of strongly representations is closed 
in the Fell topology. Theorem 2.1 (4) yields a positive answer for SO(n, 1) and 
SU(n,l). 
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8.5. It is natural to look for more classes of groups F, for which < p(T) 
< oo, especially with a precise estimate. By Theorem 4.5, this would yield 
a lower bound 5{f{T)) > p{T) for any discrete faithful representation (p into 
SO(n, 1) or SU(n, 1). Discrete subgroups of the latter groups are themselves a 
rich source of examples, and especially intriguing would be to find there non- 
lattices which satisfy equality S{T) = p{T) > 0. Can one find a group F for 
which p{T) is not an integer? What can be said about the numerous known 
hyperbolic groups acting discretely co-compactly on CAT(-l) spaces (see [HP] 
and the references cited in §5.1) ? 

Finally, as the finitely generated nonamenable groups with p{T) < 2 
(equivalently, p(F) = 0), are exactly the ones having nonvanishing first 
£^-Betti number, one can consider two properties which may be viewed as 
"almost having" positive first ^^-Betti number: satisfying p{T) = 2, and ad- 
mitting a representation with ^ 0, which weakly embeds in the regular 
representation. By [CHH] , the first implies the second, but they are not equiv- 
alent. Fundamental groups of closed (or finite volume) hyperbolic 3-manifolds 
satisfy the former, and groups which split as an amalgamated product over an 
amenable subgroup, the latter. 

Appendix: Proof of Theorem 3.7 

Although in the present paper we are interested only in SO(n, 1) and 

SU(n, 1), our treatment of the problem of inducing the first cohomology enables 
one to induce isometric actions on general CAT(O) spaces. In that framework, 
the other rank one groups are of relevance as well. The exceptional group 
-^4(-20) can be dealt with by similar methods, and is sufficiently specialized that 
we will not describe it here. Thus, in terms of the corresponding symmetric 
space, we will work here with either the complex hyperbolic space CH" {G = 
SU(n, 1)), or the quaternionic hyperbolic space QH" {G = Sp(n, 1)), where 
n > 2. 

1. Statement of the problem and some notation. Let X = G/K be either 
<CW^ or QH". Let F < G be a nonuniform lattice, which we may assume to 
be torsion free. (Hereafter, for convenience, we let F act from the left on G 
and G/K.) Let F C G/K he a fundamental domain for the action of F. As 
mentioned in Section 3. IV, such a fundamental domain consists of finitely many 
cusps, and as in there, it will suffice to study the behavior of one such cusp fi, 
which we fix once and for all in what follows. Let oo G dX be the geodesic ray 
determined by J7. Let {Ht\ t G M} be the usual foliation of horospheres which 
are based at oo. We have chosen our parameter so that the distance from Hg 
to Ht is |s — i|. 
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Let Too < r be the intersection of the cusp group P (the subgroup of 
G fixing do), with T. The subgroup Too preserves each Ht, and acts on it 
co-compactly (cf. [GR]). Let Fq C Hq be a (compact) fundamental domain 
for Too- Wc define Ft C Ht to be the set of points which he on geodesies 
determined by oo and by points of Fq. By symmetry, Ft is a fundamental 
domain for the action of Loo on Ht. Furthermore, J7 is the union of a compact 
part, irrelevant to our discussion (as our function is locally bounded), and, say, 
Us>oFs (denoted F° below). 

As is well-known by now, F is finitely generated (again, see [GR]). We 
fix a finite generating set once and for all, which may be assumed to contain 
the generators of F^, and equip F with the corresponding word length. Given 
any point x X, let w{x) be the word length of the element 7 G F for which 
7X G F. Finally, define the function f{p) on F, and the regions F^ C F by: 

f{p) = sup{w{x) I d{x,p) < 1} F' = Ut>sFt. 

Our goal is to show that / is square integrable on or equivalently, on F° 
(see Theorem 3.8 and the discussion preceding it). □ 

2. Horospherical projection. Given t > 0, there is a canonical projection 

TTt : Ht ^ Hq. This map is defined so that the geodesic determined by x and 
TTt{x) intersects dX at 00. Notice that nt commutes with the action of Foo- 
Since F^ is foliated by horospheres, we may combine the maps -Kt into a single 
projection tt : F^ ^ Hq. 

We will equip Hq with the Riemannian metric induced from the Riemann- 
ian metric on X. Let B(m) be the portion of F^ which is bounded by H^ 
and Hjn+i. In other words, let B{m) = F"^ — F^~^^. Let Bi{m) be the unit 
tubular neighborhood of B{m) in X. Let g{m) be the diameter of TT{Bi{rn)), 
and v{m) be the volume of B{m). 

2.1 Lemma. The function f is square integrable on F^ if the sequence 
{g{m)'^v{m)\ m eN} is summable. 

Proof. Given p G B{m) we define g{p) = g{m). It suffices to show that 
fip) < Cg{p) for some universal constant C and for all p G F^. If x G X is 
such that d{x,p) < 1, then x G Bi{m) and tt{x) G 7r(5i(m)). Thus, 7r(x) has 
distance at most g{m) from any point in Fq. 

Since Fq is equipped with a path metric, and Hq/T^ is compact, Hq is 
quasi- isometric to the set Foo, equipped with its word metric. This is the well- 
known criterion of Milnor-Svarc (see [Sc] for details). Thus, there is a universal 
constant C such that a word of length at most Cg{m) maps 7r(a;) to a point in 
Fq. Since Fqo commutes with tt, this same word maps x into F". □ 

It remains to estimate g{m) and v{m). 
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3. Estimates. As a preliminary step, we describe the Carnot metric on the 
horospheres Ht (for details see [Gr3] or [Sc]). Ht has a canonical nonintegrable 
distribution. This distribution has codimcnsion one in case X = CH", and 
has codimcnsion three when X = QH". The Riemannian metric on X induces 
a Riemannian metric on the planes of the distribution. One defines lengths 
of curves, integral to the distribution, via integration. It is well-known that 
every two points of Ht can be connected by an integral path, so that the infimal 
length of integral paths from x to y, called the Carnot distance, is finite. 

3.1 Lemma. There is a constant Cq such that g{m) < Coexp(m). 

Proof. The map Tit preserves the relevant distributions and T{x) = exp{t)x, 
for every vector x tangent to such a plane in the distribution on Hf. If follows 
immediately that 

dc{T^t{x),Trt{y)) =exp{t)dc{x,y), 

for all x,y E Hf. Here dc is the Carnot distance. 

Every two points x,y G Bi{m) can be connected by a path of the form 
a U /3, where T[{a) is a point, and P & Ht is integral, with t G [m, m + 1]. Since 
every Bi{m) can be isometrically embedded in Bi{k) for m > k, we can find 
a constant Co, independent of m, such that (3 has Carnot length at most Cq. 
By construction, Tr{a U /3) has Carnot length at most Coexp(m). Hence, the 
path metric distance, in Hq, from the endpoints of this projected path, is at 
most Co exp(m). □ 

3.2 Lemma. For X = CW^, there is a constant C\ such that 

v{m) < Ciexp(— 2nm). 

Here Ci depends on the group T. 

Proof. The linear differential di^t expands distances by exp(t) in all direc- 
tions tangent to the nonintegral distribution on Hf. It is a well-known fact 
that d'Kt expands distances by exp(2t) along one of the tangent vectors to Ht, 
which does not lie in the distribution. More precisely, this "extra-expanding 
vector" is generated by the Lie brackets of vectors tangent to the distribution. 
Thus, d^t multiplies the volume form on Ht by exp((2n — 2)t + 2t) = exp(2nt). 
Put the other way, cZtt^^ multiplies volumes on Hq by exp(— 2nt). The lemma 
now follows readily from integration. □ 

3.3 Lemma. For X = QH", there is a constant C2 such that 

v{m) < C2exp(— 4nm — 2m). 
Here C2 depends on the group F. 
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Proof. The proof is the same as above, except that there is now a set 
of three hnearly independent vectors tangent to Ht, which dnt expands by 
exp(2t). □ 

Conclusion of the argument. Note that n > 2. Therefore, by 3.2 and 3.3 
we have, for the two famihes, v{m) < Cexp(— 4m). Together with Lemma 3.1, 
we get 

g{rnf'v{rn) < C'exp(2m) exp(— 4to) < C'exp(— 2to), 
a sequence which is obviously summable. By Lemma 2.1 we are done. □ 
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